Sep 18 13:12:49.014941 ip-10-0-136-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 13:12:49.014957 ip-10-0-136-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 13:12:49.014967 ip-10-0-136-225 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 13:12:49.015283 ip-10-0-136-225 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 13:12:59.309147 ip-10-0-136-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 13:12:59.309159 ip-10-0-136-225 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0d3c5b2609514e9c843d702c98bb67b8 --
Sep 18 13:14:42.500457 ip-10-0-136-225 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 13:14:42.945723 ip-10-0-136-225 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:14:42.945723 ip-10-0-136-225 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 13:14:42.945723 ip-10-0-136-225 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:14:42.945723 ip-10-0-136-225 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 13:14:42.945723 ip-10-0-136-225 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:14:42.946912 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.946826    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 13:14:42.950929 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950914    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:14:42.950929 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950928    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950932    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950937    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950940    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950943    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950947    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950950    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950954    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950957    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950959    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950962    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950964    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950967    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950970    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950972    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950975    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950977    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950983    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950986    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950989    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:14:42.950996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950992    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950994    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950997    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.950999    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951002    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951005    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951008    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951011    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951013    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951016    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951019    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951021    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951024    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951026    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951029    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951031    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951034    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951037    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951041    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:14:42.951501 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951045    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951048    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951051    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951053    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951056    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951058    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951061    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951063    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951066    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951069    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951071    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951074    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951077    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951079    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951082    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951085    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951088    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951090    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951093    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951096    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:14:42.951972 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.951098    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:14:42.952863 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952854    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:14:42.952863 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952863    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952866    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952870    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952875    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952878    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952881    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952884    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952886    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952889    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952892    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952897    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952900    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952904    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952906    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952909    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952912    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952915    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952918    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952921    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:14:42.952919 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952923    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952926    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952929    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952932    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952935    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952937    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952940    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952942    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952945    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952948    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952951    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952953    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952956    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952958    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952961    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952963    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952966    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:14:42.953412 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.952968    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953641    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953647    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953650    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953654    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953659    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953662    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953665    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953668    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953671    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953674    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953676    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953679    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953682    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953685    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953697    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953700    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953703    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953706    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:14:42.953825 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953709    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953711    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953714    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953716    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953719    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953721    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953724    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953727    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953729    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953731    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953734    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953736    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953739    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953741    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953744    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953747    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953750    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953752    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953755    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953758    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:14:42.954318 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953760    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953763    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953765    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953768    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953770    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953773    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953776    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953778    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953781    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953784    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953786    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953789    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953791    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953794    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953796    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953799    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953801    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953804    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953806    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953809    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:14:42.954818 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953811    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953814    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953817    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953819    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953822    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953825    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953827    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953831    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953834    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953837    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953839    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953842    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953845    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953847    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953850    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953852    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953855    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953857    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953860    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953862    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:14:42.955338 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953865    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953868    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953872    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953875    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953878    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953880    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953883    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953886    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953889    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953891    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953893    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953897    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953900    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953903    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953906    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953909    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953911    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953914    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953917    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:14:42.955842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953921    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.953924    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954293    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954298    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954301    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954304    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954307    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954310    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954312    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954315    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954317    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954320    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954323    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954325    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954329    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954331    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954334    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954336    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954339    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:14:42.956323 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954343    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954346    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954349    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954351    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954355    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954357    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954360    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954362    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954365    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954367    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954370    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954373    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954375    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954378    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954381    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954384    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954386    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954389    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954392    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954394    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:14:42.956782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954397    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954399    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954401    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954404    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954406    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954409    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954411    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954414    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954417    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954419    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954422    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954424    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954427    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954429    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954432    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954434    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954437    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954440    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954442    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:14:42.957298 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954447    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954450    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954453    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954456    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954459    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954462    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954465    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954468    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954471    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954474    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954476    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954479    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954481    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954484    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954486    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954489    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954492    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954494    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954496    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954500    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954502    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:14:42.957803 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954505    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954508    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954512    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954515    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954518    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954520    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954523    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954526    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954529    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954531    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954534    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954536    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954538    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954541    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954543    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954546    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954548    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954551    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954554    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:14:42.958341 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954556    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954559    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.954561    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954629    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954669    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954676    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954681    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954685    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954688    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954692    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954696    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954699    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954702    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954705    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954709    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954721    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954724    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954727    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954730    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954733    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954737    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954744    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954747    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954750    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 13:14:42.958813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954753    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954756    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954760    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954763    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954766    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954769    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954774    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954777    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954780    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954783    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954786    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954790    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954793    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954796    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954799    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954801    2564 flags.go:64] FLAG: --enable-server="true"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954804    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954812    2564 flags.go:64] FLAG: --event-burst="100"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954815    2564 flags.go:64] FLAG: --event-qps="50"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954818    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954821    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954825    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954828    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954831    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954840    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 13:14:42.959410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954843    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954846    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954849    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954851    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954854    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954858    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954861    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954863    2564 flags.go:64] FLAG: --feature-gates=""
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954867    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954870    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954873    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954876    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954879    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954884    2564 flags.go:64] FLAG: --help="false"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954887    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-136-225.ec2.internal"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954890    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954893    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954896    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954900    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954903    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954906    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954908    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954911    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 13:14:42.960019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954914    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954917    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954920    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954923    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954926    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954929    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954932    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954934    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954937    2564 flags.go:64] FLAG: --lock-file=""
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954945    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954948    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954951    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954957    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954959    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954962    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954965    2564 flags.go:64] FLAG: --logging-format="text"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954968    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954971    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954974    2564 flags.go:64] FLAG: --manifest-url=""
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954977    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954981    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954984    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954988    2564 flags.go:64] FLAG: --max-pods="110"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954991    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954994    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 13:14:42.960633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.954997    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955000    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955003    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955006    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955009    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955015    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955018    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955021    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955024    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955027    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955032    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955035    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955038    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955041    2564 flags.go:64] FLAG: --port="10250"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955044    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955047    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0faf4b6eff4b78a2e"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955050    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955053    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955056    2564 flags.go:64] FLAG: --register-node="true"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955059    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955062    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955065    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955068    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955071    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955074    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 13:14:42.961303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955077    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955080    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955083    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955086    2564 flags.go:64] FLAG: --runonce="false"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955088    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955093    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955096    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955099    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955101    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955104    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955107    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955111    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955114    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955116    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955119    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955122    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955125    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955128    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955131    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955136    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955139    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955142    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955146    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955149    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955151    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 13:14:42.961926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955155    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955158    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955160    2564 flags.go:64] FLAG: --v="2"
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955164    2564 flags.go:64] FLAG: --version="false"
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955168    2564 flags.go:64] FLAG: --vmodule=""
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955171    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.955174    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955292    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955296    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955299    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955302    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955305    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955309    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955312    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955315    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955318    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955321    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955323    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955328    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955330    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955333    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955336    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:14:42.962677 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955339    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955342    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955345    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955347    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955357    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955361    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955363    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955366    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955369    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955371    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955374    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955377    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955381    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955385    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955388    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955391    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955395    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955398    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955401    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:14:42.963229 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955403    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955406    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955409    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955414    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955417    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955419    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955422    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955425    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955427    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955431    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955434    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955436    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955439    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955442    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955444    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955447    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955449    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955452    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955454    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:14:42.963695 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955457    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955459    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955462    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955464    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955467    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955469    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955472    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955475    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955477    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955480    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955483    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955486    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955488    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955491    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955493    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955496    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955500    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955502    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955505    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955507    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:14:42.964173 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955511    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955515    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955519    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955522    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955525    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955528    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955531    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955533    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955536    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955539    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955541    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955544    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955546    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955549    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955551    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955554    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955556    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955559    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955562    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955566    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:14:42.964681 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955568    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955571    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955573    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955576    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955578    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.955581    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.956235    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.963463    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.963476    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.964357    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.964364    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964423    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964428    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964431    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964435    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:14:42.965170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964438    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964441    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964444    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964447    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964451    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964454    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964457    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964460    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964463    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964466    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964468    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964471    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964473    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964477    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964481    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964484    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964487    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964490    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964493    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:14:42.965583 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964496    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964499    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964502    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964504    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964508    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964510    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964515    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964518    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964521    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964525    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964529    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964532    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964534    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964537    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964540    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964543    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964546    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964549    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964551    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964554    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:14:42.966071 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964556    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964559    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964562    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964564    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964567    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964569    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964572    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964575    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964577    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964580    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964582    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964585    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964588    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964590    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964593    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964596    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964598    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964601    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964604    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:14:42.966625 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964606    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964609    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964612    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964614    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964618    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964622    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964625    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964627    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964630    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964633    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964636    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964638    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964641    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964643    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964646    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964648    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964651    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964653    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964656    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964658    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:14:42.967097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964661    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964663    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964666    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964668    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964671    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964673    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964676    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964679    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964681    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964684    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964687    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964689    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964692    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964695    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964698    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964701    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:14:42.967610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964703    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.964708    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964823    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964828    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964831    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964834    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964836    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964839    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964842    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964844    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964847    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964849    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964852    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964854    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:14:42.967996 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964857    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964859    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964862    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964864    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964867    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964869    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964872    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964875    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964877    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964880    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964883    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964885    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964888    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964891    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964893    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964896    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964898    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964901    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964904    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964906    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:14:42.968357 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964909    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964911    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964914    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964916    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964919    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964921    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964924    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964926    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964929    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964931    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964934    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964936    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964939    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964941    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964944    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964946    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964949    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964951    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964954    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964956    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:14:42.968837 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964959    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964962    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964965    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964967    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964970    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964973    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964975    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964978    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964981    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964984    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964987    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964989    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964992    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964994    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964997    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.964999    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965002    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965006    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965010    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:14:42.969343 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965014    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965017    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965020    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965022    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965025    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965028    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965030    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965033    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965035    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965039    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965041    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965044    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965046    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965049    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965052    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965054    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965056    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965059    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965061    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965064    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:14:42.969795 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965066    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965069    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965072    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965076    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965078    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965081    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965084    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:42.965086    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.965090    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.965179    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.967541    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.968526    2564 server.go:1019] "Starting client certificate rotation"
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.968618    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:14:42.970335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.969335    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:14:42.971555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.971543    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:14:42.974367 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.973357    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:14:42.986569 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.986554    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 18 13:14:42.988229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.988215    2564 log.go:25] "Validated CRI v1 image API"
Sep 18 13:14:42.989069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.989042    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 13:14:42.992503 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.992486    2564 fs.go:135] Filesystem UUIDs: map[29f7ff5d-8e6d-4187-bf7f-7a9dcdf2f07e:/dev/nvme0n1p3 656189f5-1f61-4b35-848a-f375ff28a8e9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 18 13:14:42.992549 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.992503    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 13:14:42.997407 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.997304    2564 manager.go:216] Machine: {Timestamp:2026-09-18 13:14:42.995934469 +0000 UTC m=+0.365193842 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119676 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ff5148ea922ed3bfdc034cbd200f6 SystemUUID:ec2ff514-8ea9-22ed-3bfd-c034cbd200f6 BootID:0d3c5b26-0951-4e9c-843d-702c98bb67b8 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fd:06:5e:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fd:06:5e:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:ac:2a:da:66:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 13:14:42.997407 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.997397    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 13:14:42.997504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:42.997462    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 13:14:43.000041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.000018    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 13:14:43.000164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.000043    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 13:14:43.000904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.000893    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 13:14:43.000942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.000907    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 13:14:43.000942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.000915    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:14:43.001923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.001913    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:14:43.001985 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.001979    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 13:14:43.006536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006524    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:14:43.006655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006646    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 13:14:43.006694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006679    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 13:14:43.006694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006688    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 13:14:43.006747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006697    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 13:14:43.006747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006706    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 18 13:14:43.006747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.006713    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 13:14:43.007031 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.007010    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:14:43.007118 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.007036    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:14:43.009464 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.009448    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 13:14:43.012426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.012413    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 13:14:43.012484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.012442    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 13:14:43.014558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014544    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 13:14:43.014613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014569    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 13:14:43.014613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014579    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 13:14:43.014613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014588    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 13:14:43.014613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014600    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 13:14:43.014613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014609    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 13:14:43.014752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014629    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 13:14:43.014752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014638    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 13:14:43.014752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014648    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 13:14:43.014752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014656    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 13:14:43.014752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014667    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 13:14:43.014752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.014675    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 13:14:43.015592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.015571    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 13:14:43.015592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.015594    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 13:14:43.019281 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.019130    2564 server.go:1268] "Started kubelet"
Sep 18 13:14:43.019388 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.019188    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 13:14:43.019445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.019245    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 13:14:43.019505 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.019427    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 13:14:43.020029 ip-10-0-136-225 systemd[1]: Started Kubernetes Kubelet.
Sep 18 13:14:43.021304 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.021288    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 13:14:43.021698 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.021683    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 13:14:43.027130 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.027103    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 13:14:43.029428 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.029411    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:14:43.030644 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.030626    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 13:14:43.030860 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.029722    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c9393a0657f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.019105663 +0000 UTC m=+0.388365035,LastTimestamp:2026-09-18 13:14:43.019105663 +0000 UTC m=+0.388365035,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.034243 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.034221    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 13:14:43.034876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.034858    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 13:14:43.035102 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.035082    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.035725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035631    2564 factory.go:55] Registering systemd factory
Sep 18 13:14:43.035725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035641    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 13:14:43.035725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035659    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 13:14:43.035725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035646    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 18 13:14:43.035725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035673    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 13:14:43.036009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035770    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 13:14:43.036009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035777    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 13:14:43.036009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035899    2564 factory.go:153] Registering CRI-O factory
Sep 18 13:14:43.036009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.035912    2564 factory.go:223] Registration of the crio container factory successfully
Sep 18 13:14:43.036727 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.036711    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 13:14:43.036805 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.036744    2564 factory.go:103] Registering Raw factory
Sep 18 13:14:43.036805 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.036759    2564 manager.go:1196] Started watching for new ooms in manager
Sep 18 13:14:43.036805 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.036766    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 13:14:43.036957 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.036827    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 13:14:43.037204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.037170    2564 manager.go:349] Starting recovery of all containers
Sep 18 13:14:43.040114 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.040081    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 13:14:43.040229 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.040177    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 13:14:43.045966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.045952    2564 manager.go:354] Recovery completed
Sep 18 13:14:43.050274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.050261    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.051962 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.051936    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.052042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.051974    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.052042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.051984    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.052530 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.052518    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 13:14:43.052530 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.052530    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 13:14:43.052635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.052548    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:14:43.052635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.052532    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.053356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.053339    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.053434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.053365    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.053434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.053375    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.055061 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.055005    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c939595bed0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-225.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.051962064 +0000 UTC m=+0.421221436,LastTimestamp:2026-09-18 13:14:43.051962064 +0000 UTC m=+0.421221436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.069736 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.069675    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c939596022a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-225.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.051979306 +0000 UTC m=+0.421238679,LastTimestamp:2026-09-18 13:14:43.051979306 +0000 UTC m=+0.421238679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.074763 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.074710    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c9395962645  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-225.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.051988549 +0000 UTC m=+0.421247921,LastTimestamp:2026-09-18 13:14:43.051988549 +0000 UTC m=+0.421247921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.090039 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.089979    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-225.ec2.internal.18d66c939595bed0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c939595bed0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-225.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.051962064 +0000 UTC m=+0.421221436,LastTimestamp:2026-09-18 13:14:43.053353618 +0000 UTC m=+0.422612991,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.098572 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.098515    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-225.ec2.internal.18d66c939596022a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c939596022a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-225.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.051979306 +0000 UTC m=+0.421238679,LastTimestamp:2026-09-18 13:14:43.053370089 +0000 UTC m=+0.422629462,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.196826 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.119138    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-225.ec2.internal.18d66c9395962645\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-225.ec2.internal.18d66c9395962645  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-225.ec2.internal,UID:ip-10-0-136-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-225.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-225.ec2.internal,},FirstTimestamp:2026-09-18 13:14:43.051988549 +0000 UTC m=+0.421247921,LastTimestamp:2026-09-18 13:14:43.053379068 +0000 UTC m=+0.422638441,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-225.ec2.internal,}"
Sep 18 13:14:43.196826 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.135240    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.196826 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.195779    2564 policy_none.go:49] "None policy: Start"
Sep 18 13:14:43.196826 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.195798    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 13:14:43.196826 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.195807    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 13:14:43.198251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.198233    2564 policy_none.go:47] "Start"
Sep 18 13:14:43.206568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.206547    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 13:14:43.208245 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.207812    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 13:14:43.208245 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.207862    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 13:14:43.208245 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.207887    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 13:14:43.208245 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.207928    2564 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 18 13:14:43.211012 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.210992    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvq6d"
Sep 18 13:14:43.221753 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.221733    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 18 13:14:43.222327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.222313    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvq6d"
Sep 18 13:14:43.229708 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.229697    2564 manager.go:337] "Starting Device Plugin manager"
Sep 18 13:14:43.229784 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.229727    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 13:14:43.229784 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.229736    2564 server.go:87] "Starting device plugin registration server"
Sep 18 13:14:43.230024 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.230011    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 13:14:43.230063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.230025    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 13:14:43.230145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.230130    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 13:14:43.230272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.230220    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 13:14:43.230272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.230229    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 13:14:43.230647 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.230627    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 13:14:43.230736 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.230673    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.245529 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.245514    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-225.ec2.internal\" not found" node="ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.308656 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.308638    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"]
Sep 18 13:14:43.308725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.308704    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.309494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.309478    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.309565 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.309507    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.309565 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.309516    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.311820 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.311808    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.311921 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.311909    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.311970 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.311934    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.312511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.312487    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.312511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.312513    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.312631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.312523    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.312631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.312487    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.312631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.312589    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.312631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.312605    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.314854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.314842    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.314898 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.314865    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.315544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.315530    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.315606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.315556    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.315606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.315568    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.330172 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.330149    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:14:43.330801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.330791    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:14:43.330863 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.330812    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:14:43.330863 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.330822    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:14:43.330863 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.330838    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.336957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.336943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98f3d591fc4681e376a3c2067acadc37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal\" (UID: \"98f3d591fc4681e376a3c2067acadc37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.337001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.336965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98f3d591fc4681e376a3c2067acadc37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal\" (UID: \"98f3d591fc4681e376a3c2067acadc37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.337001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.336981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f91b419163f2290a2d25c746cd1787c2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-225.ec2.internal\" (UID: \"f91b419163f2290a2d25c746cd1787c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.342078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.342062    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.342163 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.342082    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-225.ec2.internal\": node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.342786 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.342770    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-225.ec2.internal\" not found" node="ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.346882 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.346865    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-225.ec2.internal\" not found" node="ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.407825 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.407810    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.437531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.437513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f91b419163f2290a2d25c746cd1787c2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-225.ec2.internal\" (UID: \"f91b419163f2290a2d25c746cd1787c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.437618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.437537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98f3d591fc4681e376a3c2067acadc37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal\" (UID: \"98f3d591fc4681e376a3c2067acadc37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.437618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.437552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98f3d591fc4681e376a3c2067acadc37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal\" (UID: \"98f3d591fc4681e376a3c2067acadc37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.437700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.437622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98f3d591fc4681e376a3c2067acadc37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal\" (UID: \"98f3d591fc4681e376a3c2067acadc37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.437700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.437675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98f3d591fc4681e376a3c2067acadc37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal\" (UID: \"98f3d591fc4681e376a3c2067acadc37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.437700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.437698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f91b419163f2290a2d25c746cd1787c2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-225.ec2.internal\" (UID: \"f91b419163f2290a2d25c746cd1787c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.508619 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.508575    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.609171 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.609149    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.647648 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.647630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.651878 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.651866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:43.710152 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.710135    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.810660 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.810642    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.911015 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:43.910996    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:43.968348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:43.968332    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 13:14:44.011602 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:44.011584    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-225.ec2.internal\" not found"
Sep 18 13:14:44.057909 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.057871    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:14:44.073253 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.073240    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:14:44.135088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.135062    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:44.146213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.146174    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:14:44.147984 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.147972    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal"
Sep 18 13:14:44.163862 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.163850    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:14:44.189852 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:44.189831    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f3d591fc4681e376a3c2067acadc37.slice/crio-f0bcaf7f8c6433ffcf47fef34a2102018d97d858da95c09c4a51455250eb3f56 WatchSource:0}: Error finding container f0bcaf7f8c6433ffcf47fef34a2102018d97d858da95c09c4a51455250eb3f56: Status 404 returned error can't find the container with id f0bcaf7f8c6433ffcf47fef34a2102018d97d858da95c09c4a51455250eb3f56
Sep 18 13:14:44.191077 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:44.191058    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91b419163f2290a2d25c746cd1787c2.slice/crio-857597b7d3b27d22267d97ab85278d5140e248ef0579f8b7afe1a72895af44bb WatchSource:0}: Error finding container 857597b7d3b27d22267d97ab85278d5140e248ef0579f8b7afe1a72895af44bb: Status 404 returned error can't find the container with id 857597b7d3b27d22267d97ab85278d5140e248ef0579f8b7afe1a72895af44bb
Sep 18 13:14:44.195258 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.195245    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:14:44.212488 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.212455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal" event={"ID":"98f3d591fc4681e376a3c2067acadc37","Type":"ContainerStarted","Data":"f0bcaf7f8c6433ffcf47fef34a2102018d97d858da95c09c4a51455250eb3f56"}
Sep 18 13:14:44.213447 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.213426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal" event={"ID":"f91b419163f2290a2d25c746cd1787c2","Type":"ContainerStarted","Data":"857597b7d3b27d22267d97ab85278d5140e248ef0579f8b7afe1a72895af44bb"}
Sep 18 13:14:44.228175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.228142    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 13:09:43 +0000 UTC" deadline="2028-04-17 09:02:55.939267013 +0000 UTC"
Sep 18 13:14:44.228175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.228170    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13843h48m11.711099126s"
Sep 18 13:14:44.430615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.430573    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:14:44.544160 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:44.544145    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:14:45.008237 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.008214    2564 apiserver.go:52] "Watching apiserver"
Sep 18 13:14:45.017126 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.017106    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 13:14:45.017708 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.017673    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-nvg6n","kube-system/global-pull-secret-syncer-f855x","kube-system/konnectivity-agent-8d5kd","kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4n2q9","openshift-dns/node-resolver-9f9fm","openshift-image-registry/node-ca-s4jt7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal","openshift-multus/multus-additional-cni-plugins-d7pzx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf","openshift-multus/multus-hxrxz","openshift-multus/network-metrics-daemon-brm8b","openshift-network-diagnostics/network-check-target-cm6rb","openshift-network-operator/iptables-alerter-s7286"]
Sep 18 13:14:45.020151 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.020130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.022239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.022217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.022377 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.022284    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:45.024299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.024280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.025895 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.025880    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 13:14:45.025978 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.025916    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 13:14:45.026073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.026051    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.026465 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.026446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 13:14:45.026600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.026447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 13:14:45.026663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.026620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zxldr\""
Sep 18 13:14:45.027403 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.027383    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.027694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.027532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.027694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.027542    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 13:14:45.027694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.027552    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zb4hw\""
Sep 18 13:14:45.028204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.028174    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 13:14:45.029371 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.029355    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.031493 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.031470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.031577 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.031501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.031638 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.031615    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qcxdz\""
Sep 18 13:14:45.031941 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.031924    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.032017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.031965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9rlwz\""
Sep 18 13:14:45.032066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.032055    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.032359 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.032347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.033789 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.033774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.034806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.034641    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.034806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.034658    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.034806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.034771    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 13:14:45.035277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.035152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wfpgq\""
Sep 18 13:14:45.035346 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.035273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 13:14:45.036380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.036353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.038594 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.038381    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.040000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.039986    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 13:14:45.040101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.040086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.040157 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.040137    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-krbtm\""
Sep 18 13:14:45.040844 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.040829    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 13:14:45.040924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.040853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.040924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.040901    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 13:14:45.040924 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.040907    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:45.041057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.040950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.041564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.041537    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.041564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.041549    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6zks5\""
Sep 18 13:14:45.041700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.041603    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 13:14:45.043253 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.042367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2blz6\""
Sep 18 13:14:45.044665 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.044252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:45.044665 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.044314    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:45.045098 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.045240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.045240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-system-cni-dir\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.045240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.045240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-run-netns\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ms77\" (UniqueName: \"kubernetes.io/projected/011f5db6-2d23-4056-91ce-209f7ba685d7-kube-api-access-9ms77\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovn-node-metrics-cert\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-lib-modules\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-systemd-units\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x9xg\" (UniqueName: \"kubernetes.io/projected/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-kube-api-access-9x9xg\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-tmp-dir\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-ovn\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-hosts-file\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b7d6d82-0974-4bde-83b4-1199b59617b4-dbus\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-modprobe-d\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysctl-d\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-systemd\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56161884-9e0b-4665-8894-60e02855e197-etc-tuned\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5cb7e-2581-4102-b402-5c4c03bf77ba-konnectivity-ca\") pod \"konnectivity-agent-8d5kd\" (UID: \"9bf5cb7e-2581-4102-b402-5c4c03bf77ba\") " pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.045809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-var-lib-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfc84\" (UniqueName: \"kubernetes.io/projected/813df9b5-73da-4639-9d03-550391e4313a-kube-api-access-vfc84\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.045867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b7d6d82-0974-4bde-83b4-1199b59617b4-kubelet-config\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bf5cb7e-2581-4102-b402-5c4c03bf77ba-agent-certs\") pod \"konnectivity-agent-8d5kd\" (UID: \"9bf5cb7e-2581-4102-b402-5c4c03bf77ba\") " pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046249    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-run\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.046381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-var-lib-kubelet\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56161884-9e0b-4665-8894-60e02855e197-tmp\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-slash\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-systemd\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysconfig\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-host\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovnkube-script-lib\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7cw5\" (UniqueName: \"kubernetes.io/projected/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-kube-api-access-x7cw5\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.046673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysctl-conf\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-socket-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-node-log\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-env-overrides\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-kubernetes\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hrk5\" (UniqueName: \"kubernetes.io/projected/56161884-9e0b-4665-8894-60e02855e197-kube-api-access-4hrk5\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-etc-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovnkube-config\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.046986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-cnibin\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.047005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-registration-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.047056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.047052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-log-socket\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.047527 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.047492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-cni-netd\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.047997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/813df9b5-73da-4639-9d03-550391e4313a-host\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-sys\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.047617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-sys-fs\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-kubelet\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-cni-bin\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-device-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28p6p\" (UniqueName: \"kubernetes.io/projected/76f59116-006d-47ad-b758-bebab2bcaada-kube-api-access-28p6p\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.048309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.048159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/813df9b5-73da-4639-9d03-550391e4313a-serviceca\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.052328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.052311    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 13:14:45.052411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.052332    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:14:45.052554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.052539    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 13:14:45.052880 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.052855    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkb2b\""
Sep 18 13:14:45.056411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.056393    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:14:45.093357 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.093339    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c98bn"
Sep 18 13:14:45.107922 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.107904    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c98bn"
Sep 18 13:14:45.136999 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.136982    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 13:14:45.149224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-daemon-config\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.149300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm47r\" (UniqueName: \"kubernetes.io/projected/b17f51df-69a0-44d3-95ea-ccb145819dcf-kube-api-access-nm47r\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.149300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-ovn\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.149300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-hosts-file\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.149300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b7d6d82-0974-4bde-83b4-1199b59617b4-dbus\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-modprobe-d\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysctl-d\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-ovn\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-hosts-file\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b7d6d82-0974-4bde-83b4-1199b59617b4-dbus\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-systemd\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-systemd\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56161884-9e0b-4665-8894-60e02855e197-etc-tuned\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-modprobe-d\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5cb7e-2581-4102-b402-5c4c03bf77ba-konnectivity-ca\") pod \"konnectivity-agent-8d5kd\" (UID: \"9bf5cb7e-2581-4102-b402-5c4c03bf77ba\") " pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.149492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysctl-d\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-var-lib-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-system-cni-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-hostroot\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfc84\" (UniqueName: \"kubernetes.io/projected/813df9b5-73da-4639-9d03-550391e4313a-kube-api-access-vfc84\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b7d6d82-0974-4bde-83b4-1199b59617b4-kubelet-config\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bf5cb7e-2581-4102-b402-5c4c03bf77ba-agent-certs\") pod \"konnectivity-agent-8d5kd\" (UID: \"9bf5cb7e-2581-4102-b402-5c4c03bf77ba\") " pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-run\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-var-lib-kubelet\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56161884-9e0b-4665-8894-60e02855e197-tmp\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-slash\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-systemd\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysconfig\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-host\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovnkube-script-lib\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7cw5\" (UniqueName: \"kubernetes.io/projected/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-kube-api-access-x7cw5\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.150017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-cni-bin\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysctl-conf\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-socket-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149931    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-node-log\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9bf5cb7e-2581-4102-b402-5c4c03bf77ba-konnectivity-ca\") pod \"konnectivity-agent-8d5kd\" (UID: \"9bf5cb7e-2581-4102-b402-5c4c03bf77ba\") " pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-env-overrides\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.149993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-var-lib-kubelet\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8daf9a95-3596-42be-8deb-eddc5cf0efa8-host-slash\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-var-lib-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwg7\" (UniqueName: \"kubernetes.io/projected/8daf9a95-3596-42be-8deb-eddc5cf0efa8-kube-api-access-6gwg7\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-kubernetes\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150282    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-kubernetes\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hrk5\" (UniqueName: \"kubernetes.io/projected/56161884-9e0b-4665-8894-60e02855e197-kube-api-access-4hrk5\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-run\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.150097    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-etc-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.150744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-slash\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-systemd\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovnkube-config\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.150416    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:14:45.650393252 +0000 UTC m=+3.019652628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b17f51df-69a0-44d3-95ea-ccb145819dcf-cni-binary-copy\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-cnibin\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-registration-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-log-socket\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150582    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-cni-netd\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/813df9b5-73da-4639-9d03-550391e4313a-host\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysctl-conf\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-conf-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-multus-certs\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-sys\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.151534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-sys-fs\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-kubelet\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-env-overrides\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-cnibin\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-etc-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/813df9b5-73da-4639-9d03-550391e4313a-host\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150860    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovnkube-config\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-kubelet\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-sys-fs\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-k8s-cni-cncf-io\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-cnibin\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-cni-netd\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-sys\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150931    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-socket-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150976    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b7d6d82-0974-4bde-83b4-1199b59617b4-kubelet-config\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-netns\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.150930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-node-log\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.152272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-etc-kubernetes\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-host\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-registration-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk7gz\" (UniqueName: \"kubernetes.io/projected/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-kube-api-access-zk7gz\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-cni-bin\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-cni-bin\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-cni-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-cni-multus\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-kubelet\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-log-socket\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8daf9a95-3596-42be-8deb-eddc5cf0efa8-iptables-alerter-script\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-device-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28p6p\" (UniqueName: \"kubernetes.io/projected/76f59116-006d-47ad-b758-bebab2bcaada-kube-api-access-28p6p\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/813df9b5-73da-4639-9d03-550391e4313a-serviceca\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-etc-sysconfig\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-device-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-system-cni-dir\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151510    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-system-cni-dir\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-run-netns\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovnkube-script-lib\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-socket-dir-parent\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ms77\" (UniqueName: \"kubernetes.io/projected/011f5db6-2d23-4056-91ce-209f7ba685d7-kube-api-access-9ms77\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovn-node-metrics-cert\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-lib-modules\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/011f5db6-2d23-4056-91ce-209f7ba685d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-systemd-units\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x9xg\" (UniqueName: \"kubernetes.io/projected/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-kube-api-access-9x9xg\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.153849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-tmp-dir\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56161884-9e0b-4665-8894-60e02855e197-lib-modules\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-run-netns\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/011f5db6-2d23-4056-91ce-209f7ba685d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.151969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-run-openvswitch\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.152030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/813df9b5-73da-4639-9d03-550391e4313a-serviceca\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.152048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-tmp-dir\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.152072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-systemd-units\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.152114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-etc-selinux\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.152170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76f59116-006d-47ad-b758-bebab2bcaada-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.153867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56161884-9e0b-4665-8894-60e02855e197-etc-tuned\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.154098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9bf5cb7e-2581-4102-b402-5c4c03bf77ba-agent-certs\") pod \"konnectivity-agent-8d5kd\" (UID: \"9bf5cb7e-2581-4102-b402-5c4c03bf77ba\") " pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.154293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56161884-9e0b-4665-8894-60e02855e197-tmp\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.154595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.154333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-ovn-node-metrics-cert\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.173694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.173676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7cw5\" (UniqueName: \"kubernetes.io/projected/6b6e712a-ca30-4bab-aeb4-ec3506cd5af5-kube-api-access-x7cw5\") pod \"node-resolver-9f9fm\" (UID: \"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5\") " pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.174388 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.174369    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28p6p\" (UniqueName: \"kubernetes.io/projected/76f59116-006d-47ad-b758-bebab2bcaada-kube-api-access-28p6p\") pod \"aws-ebs-csi-driver-node-nwbcf\" (UID: \"76f59116-006d-47ad-b758-bebab2bcaada\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.176709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.176683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfc84\" (UniqueName: \"kubernetes.io/projected/813df9b5-73da-4639-9d03-550391e4313a-kube-api-access-vfc84\") pod \"node-ca-s4jt7\" (UID: \"813df9b5-73da-4639-9d03-550391e4313a\") " pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.177383 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.177367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ms77\" (UniqueName: \"kubernetes.io/projected/011f5db6-2d23-4056-91ce-209f7ba685d7-kube-api-access-9ms77\") pod \"multus-additional-cni-plugins-d7pzx\" (UID: \"011f5db6-2d23-4056-91ce-209f7ba685d7\") " pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.178396 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.178381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x9xg\" (UniqueName: \"kubernetes.io/projected/23b9fa98-ef8e-4d95-a85d-7578c03c6e65-kube-api-access-9x9xg\") pod \"ovnkube-node-nvg6n\" (UID: \"23b9fa98-ef8e-4d95-a85d-7578c03c6e65\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.183010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.182992    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hrk5\" (UniqueName: \"kubernetes.io/projected/56161884-9e0b-4665-8894-60e02855e197-kube-api-access-4hrk5\") pod \"tuned-4n2q9\" (UID: \"56161884-9e0b-4665-8894-60e02855e197\") " pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.252198 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-cni-bin\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8daf9a95-3596-42be-8deb-eddc5cf0efa8-host-slash\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.252298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-cni-bin\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8daf9a95-3596-42be-8deb-eddc5cf0efa8-host-slash\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.252397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwg7\" (UniqueName: \"kubernetes.io/projected/8daf9a95-3596-42be-8deb-eddc5cf0efa8-kube-api-access-6gwg7\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.252397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b17f51df-69a0-44d3-95ea-ccb145819dcf-cni-binary-copy\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.252544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-conf-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-multus-certs\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-cnibin\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-k8s-cni-cncf-io\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-netns\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.252580    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-etc-kubernetes\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.252641    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:14:45.752625773 +0000 UTC m=+3.121885148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk7gz\" (UniqueName: \"kubernetes.io/projected/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-kube-api-access-zk7gz\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-cni-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.252718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-cni-multus\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-kubelet\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-cnibin\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-k8s-cni-cncf-io\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8daf9a95-3596-42be-8deb-eddc5cf0efa8-iptables-alerter-script\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252841    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-netns\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-socket-dir-parent\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-daemon-config\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm47r\" (UniqueName: \"kubernetes.io/projected/b17f51df-69a0-44d3-95ea-ccb145819dcf-kube-api-access-nm47r\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-conf-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-system-cni-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-cni-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-run-multus-certs\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-etc-kubernetes\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-cni-multus\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-hostroot\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.252968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-socket-dir-parent\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.253009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-host-var-lib-kubelet\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.253081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-hostroot\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.253129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b17f51df-69a0-44d3-95ea-ccb145819dcf-system-cni-dir\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.253454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8daf9a95-3596-42be-8deb-eddc5cf0efa8-iptables-alerter-script\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.253829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.253675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b17f51df-69a0-44d3-95ea-ccb145819dcf-multus-daemon-config\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.253829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.253722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b17f51df-69a0-44d3-95ea-ccb145819dcf-cni-binary-copy\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.267922 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.265733    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:14:45.267922 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.265759    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:14:45.267922 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.265770    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:45.267922 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.265831    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:14:45.7658153 +0000 UTC m=+3.135074675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:45.267922 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.265857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwg7\" (UniqueName: \"kubernetes.io/projected/8daf9a95-3596-42be-8deb-eddc5cf0efa8-kube-api-access-6gwg7\") pod \"iptables-alerter-s7286\" (UID: \"8daf9a95-3596-42be-8deb-eddc5cf0efa8\") " pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.267922 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.266260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk7gz\" (UniqueName: \"kubernetes.io/projected/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-kube-api-access-zk7gz\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.268619 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.268597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm47r\" (UniqueName: \"kubernetes.io/projected/b17f51df-69a0-44d3-95ea-ccb145819dcf-kube-api-access-nm47r\") pod \"multus-hxrxz\" (UID: \"b17f51df-69a0-44d3-95ea-ccb145819dcf\") " pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.330173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.330149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:14:45.339123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.339102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:14:45.348566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.348548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n2q9"
Sep 18 13:14:45.353464 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.353449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9f9fm"
Sep 18 13:14:45.360615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.360596    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s4jt7"
Sep 18 13:14:45.368010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.367990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d7pzx"
Sep 18 13:14:45.373243 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.373227    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf"
Sep 18 13:14:45.378555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.378539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hxrxz"
Sep 18 13:14:45.385709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.385696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s7286"
Sep 18 13:14:45.655529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.655469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:45.655643 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.655598    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:45.655678 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.655656    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:14:46.655639887 +0000 UTC m=+4.024899253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:45.756639 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.756612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:45.756754 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.756735    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:45.756811 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.756793    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:14:46.756775586 +0000 UTC m=+4.126034966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:45.857104 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:45.857076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:45.857266 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.857247    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:14:45.857266 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.857266    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:14:45.857378 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.857277    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:45.857378 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:45.857333    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:14:46.85731547 +0000 UTC m=+4.226574830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:46.005671 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.005644    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56161884_9e0b_4665_8894_60e02855e197.slice/crio-707d527db4e3bb8960c3ccba24e714ce47b8f385e2ddd1b4ba0ae8b6726a0946 WatchSource:0}: Error finding container 707d527db4e3bb8960c3ccba24e714ce47b8f385e2ddd1b4ba0ae8b6726a0946: Status 404 returned error can't find the container with id 707d527db4e3bb8960c3ccba24e714ce47b8f385e2ddd1b4ba0ae8b6726a0946
Sep 18 13:14:46.006800 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.006758    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf5cb7e_2581_4102_b402_5c4c03bf77ba.slice/crio-e7464e4921fe82065a13e712386cc836676889bae2db761009e8caa54fe7429d WatchSource:0}: Error finding container e7464e4921fe82065a13e712386cc836676889bae2db761009e8caa54fe7429d: Status 404 returned error can't find the container with id e7464e4921fe82065a13e712386cc836676889bae2db761009e8caa54fe7429d
Sep 18 13:14:46.009831 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.009811    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f59116_006d_47ad_b758_bebab2bcaada.slice/crio-15a3ffafa266e99743a8f596a6d00e8222e89eb62bf6c751018e67857189dea4 WatchSource:0}: Error finding container 15a3ffafa266e99743a8f596a6d00e8222e89eb62bf6c751018e67857189dea4: Status 404 returned error can't find the container with id 15a3ffafa266e99743a8f596a6d00e8222e89eb62bf6c751018e67857189dea4
Sep 18 13:14:46.011371 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.011290    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17f51df_69a0_44d3_95ea_ccb145819dcf.slice/crio-6a1d87c860738277ac76c7315093195587690ae1c37e688031238818e1ae51f5 WatchSource:0}: Error finding container 6a1d87c860738277ac76c7315093195587690ae1c37e688031238818e1ae51f5: Status 404 returned error can't find the container with id 6a1d87c860738277ac76c7315093195587690ae1c37e688031238818e1ae51f5
Sep 18 13:14:46.012807 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.012781    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b9fa98_ef8e_4d95_a85d_7578c03c6e65.slice/crio-475e3d588d392e52d2eb861da47e606d4a48e498a946f6208fdd846c7052bbb8 WatchSource:0}: Error finding container 475e3d588d392e52d2eb861da47e606d4a48e498a946f6208fdd846c7052bbb8: Status 404 returned error can't find the container with id 475e3d588d392e52d2eb861da47e606d4a48e498a946f6208fdd846c7052bbb8
Sep 18 13:14:46.013711 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.013689    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daf9a95_3596_42be_8deb_eddc5cf0efa8.slice/crio-89e286c290c4fe8262714651e719a3d5ddcf8ff43c7d79303ca197d5c5f1214e WatchSource:0}: Error finding container 89e286c290c4fe8262714651e719a3d5ddcf8ff43c7d79303ca197d5c5f1214e: Status 404 returned error can't find the container with id 89e286c290c4fe8262714651e719a3d5ddcf8ff43c7d79303ca197d5c5f1214e
Sep 18 13:14:46.015215 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:14:46.015068    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011f5db6_2d23_4056_91ce_209f7ba685d7.slice/crio-2026e324a23c160691c064df5a7be4c8be8940f6e7376daf8eba5b9b3de4fc9c WatchSource:0}: Error finding container 2026e324a23c160691c064df5a7be4c8be8940f6e7376daf8eba5b9b3de4fc9c: Status 404 returned error can't find the container with id 2026e324a23c160691c064df5a7be4c8be8940f6e7376daf8eba5b9b3de4fc9c
Sep 18 13:14:46.112170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.112143    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:09:45 +0000 UTC" deadline="2028-05-23 13:35:11.675645886 +0000 UTC"
Sep 18 13:14:46.112170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.112169    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14712h20m25.563480019s"
Sep 18 13:14:46.208114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.208094    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:46.208249 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.208231    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:46.219665 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.219644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n2q9" event={"ID":"56161884-9e0b-4665-8894-60e02855e197","Type":"ContainerStarted","Data":"707d527db4e3bb8960c3ccba24e714ce47b8f385e2ddd1b4ba0ae8b6726a0946"}
Sep 18 13:14:46.220787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.220760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s4jt7" event={"ID":"813df9b5-73da-4639-9d03-550391e4313a","Type":"ContainerStarted","Data":"e33020f5076c99ff4212a2ded749e8efa2f33323b68aa5c131a09b4014b25509"}
Sep 18 13:14:46.223257 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.223223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s7286" event={"ID":"8daf9a95-3596-42be-8deb-eddc5cf0efa8","Type":"ContainerStarted","Data":"89e286c290c4fe8262714651e719a3d5ddcf8ff43c7d79303ca197d5c5f1214e"}
Sep 18 13:14:46.224444 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.224422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9f9fm" event={"ID":"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5","Type":"ContainerStarted","Data":"f02f218c6a41205215d77b8451c25ba8320d38e243528d5058b82c56034d7bfa"}
Sep 18 13:14:46.225585 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.225565    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"475e3d588d392e52d2eb861da47e606d4a48e498a946f6208fdd846c7052bbb8"}
Sep 18 13:14:46.226649 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.226629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf" event={"ID":"76f59116-006d-47ad-b758-bebab2bcaada","Type":"ContainerStarted","Data":"15a3ffafa266e99743a8f596a6d00e8222e89eb62bf6c751018e67857189dea4"}
Sep 18 13:14:46.228930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.228901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal" event={"ID":"f91b419163f2290a2d25c746cd1787c2","Type":"ContainerStarted","Data":"347a8d91fe34591ab5de77e6398d48a93ff8b2b60db395dd40f1caf1d87c646d"}
Sep 18 13:14:46.230883 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.230862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerStarted","Data":"2026e324a23c160691c064df5a7be4c8be8940f6e7376daf8eba5b9b3de4fc9c"}
Sep 18 13:14:46.231909 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.231889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hxrxz" event={"ID":"b17f51df-69a0-44d3-95ea-ccb145819dcf","Type":"ContainerStarted","Data":"6a1d87c860738277ac76c7315093195587690ae1c37e688031238818e1ae51f5"}
Sep 18 13:14:46.232975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.232955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8d5kd" event={"ID":"9bf5cb7e-2581-4102-b402-5c4c03bf77ba","Type":"ContainerStarted","Data":"e7464e4921fe82065a13e712386cc836676889bae2db761009e8caa54fe7429d"}
Sep 18 13:14:46.269124 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.269085    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-225.ec2.internal" podStartSLOduration=3.269074557 podStartE2EDuration="3.269074557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:14:46.269045682 +0000 UTC m=+3.638305063" watchObservedRunningTime="2026-09-18 13:14:46.269074557 +0000 UTC m=+3.638333937"
Sep 18 13:14:46.666233 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.666118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:46.666396 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.666318    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:46.666396 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.666375    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:14:48.666357943 +0000 UTC m=+6.035617305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:46.767499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.767447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:46.767673 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.767585    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:46.767673 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.767650    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:14:48.767633555 +0000 UTC m=+6.136892923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:46.868773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:46.868737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:46.868946 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.868893    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:14:46.868946 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.868918    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:14:46.868946 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.868932    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:46.869115 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:46.868985    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:14:48.868967094 +0000 UTC m=+6.238226457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:47.113223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:47.113075    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:09:45 +0000 UTC" deadline="2028-05-12 03:42:16.39758403 +0000 UTC"
Sep 18 13:14:47.113223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:47.113131    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14438h27m29.284457158s"
Sep 18 13:14:47.211012 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:47.210984    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:47.211175 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:47.211107    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:47.211516 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:47.211495    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:47.211604 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:47.211585    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:47.248101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:47.248067    2564 generic.go:356] "Generic (PLEG): container finished" podID="98f3d591fc4681e376a3c2067acadc37" containerID="f01455ad4e8086c2c7c055ea59920459b81f18f54afa837d38ed71fb03dded0d" exitCode=0
Sep 18 13:14:47.248950 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:47.248925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal" event={"ID":"98f3d591fc4681e376a3c2067acadc37","Type":"ContainerDied","Data":"f01455ad4e8086c2c7c055ea59920459b81f18f54afa837d38ed71fb03dded0d"}
Sep 18 13:14:48.209133 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:48.208590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:48.209133 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.208756    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:48.271119 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:48.271087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal" event={"ID":"98f3d591fc4681e376a3c2067acadc37","Type":"ContainerStarted","Data":"ca888fb5ce6df21290c9c8e638701c4694e603404cdc1456e97b61ce38a2f6fc"}
Sep 18 13:14:48.292273 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:48.291834    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-225.ec2.internal" podStartSLOduration=5.291815197 podStartE2EDuration="5.291815197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:14:48.291806561 +0000 UTC m=+5.661065967" watchObservedRunningTime="2026-09-18 13:14:48.291815197 +0000 UTC m=+5.661074580"
Sep 18 13:14:48.683842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:48.683225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:48.683842 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.683411    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:48.683842 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.683469    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:14:52.68345128 +0000 UTC m=+10.052710663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:48.783748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:48.783713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:48.783928 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.783883    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:48.783998 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.783941    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:14:52.783924395 +0000 UTC m=+10.153183761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:48.886067 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:48.885339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:48.886067 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.885478    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:14:48.886067 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.885495    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:14:48.886067 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.885506    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:48.886067 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:48.885554    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:14:52.885537596 +0000 UTC m=+10.254796962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:49.208311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:49.208282    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:49.208488 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:49.208298    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:49.208488 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:49.208425    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:49.208612 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:49.208496    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:50.208544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:50.208012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:50.208544 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:50.208156    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:51.208462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:51.208420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:51.208462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:51.208451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:51.209001 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:51.208564    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:51.209001 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:51.208614    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:52.208246 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:52.208214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:52.208423 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.208357    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:52.717178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:52.717145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:52.717584 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.717307    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:52.717584 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.717362    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:00.717346889 +0000 UTC m=+18.086606249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:14:52.817762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:52.817729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:52.817925 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.817873    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:52.817982 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.817936    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:00.817916519 +0000 UTC m=+18.187175903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:14:52.918975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:52.918406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:52.918975 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.918579    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:14:52.918975 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.918596    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:14:52.918975 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.918609    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:52.918975 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:52.918661    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:15:00.918643903 +0000 UTC m=+18.287903279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:14:53.210217 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:53.209660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:53.210217 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:53.209769    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:53.210217 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:53.209818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:53.210217 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:53.209880    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:54.208862 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:54.208362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:54.208862 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:54.208493    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:55.208390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:55.208361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:55.208559 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:55.208481    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:55.208559 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:55.208534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:55.208681 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:55.208640    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:56.208050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:56.208016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:56.208419 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:56.208128    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:57.208243 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:57.208203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:57.208666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:57.208215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:57.208666 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:57.208322    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:14:57.208666 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:57.208379    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:58.208208 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:58.208165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:14:58.208389 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:58.208306    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:14:59.208736 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:59.208695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:14:59.209175 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:59.208826    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:14:59.209175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:14:59.208878    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:14:59.209175 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:14:59.208998    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:00.208986 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:00.208958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:00.209454 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.209065    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:00.778486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:00.778452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:00.778667 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.778588    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:15:00.778667 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.778651    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:16.778631404 +0000 UTC m=+34.147890765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:15:00.879075 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:00.879046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:00.879249 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.879226    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:15:00.879312 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.879301    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:16.879280218 +0000 UTC m=+34.248539585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:15:00.979814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:00.979787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:00.979959 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.979935    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:15:00.979959 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.979950    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:15:00.979959 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.979959    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:15:00.980103 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:00.980032    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:15:16.980013335 +0000 UTC m=+34.349272705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:15:01.208592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:01.208521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:01.208773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:01.208524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:01.208773 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:01.208637    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:01.208773 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:01.208725    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:02.208746 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:02.208706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:02.209207 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:02.208846    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:03.209037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:03.209004    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:03.209446 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:03.209099    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:03.209446 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:03.209157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:03.209446 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:03.209240    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:04.209083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.208962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:04.209499 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:04.209175    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:04.303491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.303462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf" event={"ID":"76f59116-006d-47ad-b758-bebab2bcaada","Type":"ContainerStarted","Data":"4f3400ef0824f0e8a6940c7d26bcce4b83a3429123c88497965bf60fb278677f"}
Sep 18 13:15:04.305000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.304978    2564 generic.go:356] "Generic (PLEG): container finished" podID="011f5db6-2d23-4056-91ce-209f7ba685d7" containerID="fbbf7cb819fb24d63b3b0224bc3bd5247fc47d24db989d476b3db35d03c93c6c" exitCode=0
Sep 18 13:15:04.305084 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.305042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerDied","Data":"fbbf7cb819fb24d63b3b0224bc3bd5247fc47d24db989d476b3db35d03c93c6c"}
Sep 18 13:15:04.306655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.306631    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hxrxz" event={"ID":"b17f51df-69a0-44d3-95ea-ccb145819dcf","Type":"ContainerStarted","Data":"0abc124d72cf57bb760c6b9ac6fb1762fe5018ff5a385f4e5c4e0368ef1c13d9"}
Sep 18 13:15:04.308139 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.308119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8d5kd" event={"ID":"9bf5cb7e-2581-4102-b402-5c4c03bf77ba","Type":"ContainerStarted","Data":"6f8281b0a3bf801c5053f1edb104dcfdf6fe889d494b19c57bd6453a74ecc34a"}
Sep 18 13:15:04.309629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.309606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n2q9" event={"ID":"56161884-9e0b-4665-8894-60e02855e197","Type":"ContainerStarted","Data":"4236fe4068f774fa2de378272a946ccd38f8df55fac240b6e9e08ee21500c560"}
Sep 18 13:15:04.311164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.311139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s4jt7" event={"ID":"813df9b5-73da-4639-9d03-550391e4313a","Type":"ContainerStarted","Data":"87410aac9a4d26ead51a8a398fcd77676929380a2afa934ddc7ddb818c2f32e0"}
Sep 18 13:15:04.313459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.313435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9f9fm" event={"ID":"6b6e712a-ca30-4bab-aeb4-ec3506cd5af5","Type":"ContainerStarted","Data":"27e671e7a94e668b3c29193e872fa4bbee0376ba156b6b762c46619583780059"}
Sep 18 13:15:04.315806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.315780    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:15:04.316188 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.316166    2564 generic.go:356] "Generic (PLEG): container finished" podID="23b9fa98-ef8e-4d95-a85d-7578c03c6e65" containerID="110458c5aef8cf4d02ef773f00b3c0c81a610e0136a174d41eeeb72c3d39ede0" exitCode=1
Sep 18 13:15:04.316274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.316211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"445106d34d1fc5d4b7bbe9a5f82cb6643e2cc0bd02360e8908e5db06b673a18b"}
Sep 18 13:15:04.316274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.316260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"3607be5c7b088b060dd81fccd266975583d68fe4922db6b1d5045f80407c8e61"}
Sep 18 13:15:04.316334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.316289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerDied","Data":"110458c5aef8cf4d02ef773f00b3c0c81a610e0136a174d41eeeb72c3d39ede0"}
Sep 18 13:15:04.316334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.316319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"4682a8efc282c10fa89f89966b0e38f6c5659ae9f8400b14e770592b76d08439"}
Sep 18 13:15:04.344846 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.344812    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8d5kd" podStartSLOduration=11.053301752 podStartE2EDuration="21.344797878s" totalImagesPullingTime="10.291496126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:04.344478748 +0000 UTC m=+21.713738131" watchObservedRunningTime="2026-09-18 13:15:04.344797878 +0000 UTC m=+21.714057259"
Sep 18 13:15:04.359183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.359146    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9f9fm" podStartSLOduration=3.51976075 podStartE2EDuration="21.359133071s" totalImagesPullingTime="17.839372321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:04.358883046 +0000 UTC m=+21.728142429" watchObservedRunningTime="2026-09-18 13:15:04.359133071 +0000 UTC m=+21.728392452"
Sep 18 13:15:04.375663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.375629    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s4jt7" podStartSLOduration=3.53705541 podStartE2EDuration="21.375616968s" totalImagesPullingTime="17.838561558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:04.375517084 +0000 UTC m=+21.744776465" watchObservedRunningTime="2026-09-18 13:15:04.375616968 +0000 UTC m=+21.744876351"
Sep 18 13:15:04.396547 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.396506    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4n2q9" podStartSLOduration=3.547025509 podStartE2EDuration="21.396495026s" totalImagesPullingTime="17.849469517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:04.395988884 +0000 UTC m=+21.765248266" watchObservedRunningTime="2026-09-18 13:15:04.396495026 +0000 UTC m=+21.765754407"
Sep 18 13:15:04.416907 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.416878    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hxrxz" podStartSLOduration=3.354819987 podStartE2EDuration="21.416866511s" totalImagesPullingTime="18.062046524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:04.416852125 +0000 UTC m=+21.786111506" watchObservedRunningTime="2026-09-18 13:15:04.416866511 +0000 UTC m=+21.786125893"
Sep 18 13:15:04.985728 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:04.985586    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 13:15:05.208494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.208467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:05.208657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.208472    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:05.208657 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:05.208584    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:05.208657 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:05.208635    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:05.240844 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.240769    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:15:04.985724662Z","UUID":"a04ddd47-96ad-4f12-ad53-1cd58860ee8b","Handler":null,"Name":"","Endpoint":""}
Sep 18 13:15:05.242405 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.242387    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 13:15:05.242527 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.242415    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 13:15:05.320266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.320234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s7286" event={"ID":"8daf9a95-3596-42be-8deb-eddc5cf0efa8","Type":"ContainerStarted","Data":"89eb9d655d93043c661fa6d91261f2cd63e4a3fe0b644fe34c971d088e15b602"}
Sep 18 13:15:05.324788 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.324766    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:15:05.325239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.325218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"0a072b9b807d2d1b27bb925d199ae2ae67cad3ef64d2cca43785e389dab449d7"}
Sep 18 13:15:05.325343 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.325303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"30a44183e09e23d81f57603f587a0c121368ebc7edb3c9c9fdf1057ecab0fc12"}
Sep 18 13:15:05.327213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.327177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf" event={"ID":"76f59116-006d-47ad-b758-bebab2bcaada","Type":"ContainerStarted","Data":"5bc0fc592f9b5063a381a898d791ae82c5fdfe7acb09961146022a571c22e224"}
Sep 18 13:15:05.340094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:05.340056    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s7286" podStartSLOduration=4.49878653 podStartE2EDuration="22.340044336s" totalImagesPullingTime="17.841257806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:05.339714451 +0000 UTC m=+22.708973836" watchObservedRunningTime="2026-09-18 13:15:05.340044336 +0000 UTC m=+22.709303718"
Sep 18 13:15:06.208835 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:06.208809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:06.208960 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:06.208933    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:06.332128 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:06.332065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf" event={"ID":"76f59116-006d-47ad-b758-bebab2bcaada","Type":"ContainerStarted","Data":"0a972850bb203414a4a87c231b3f8e152e2ed98467d02940e4713cab210bf908"}
Sep 18 13:15:07.208473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:07.208436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:07.208473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:07.208471    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:07.208825 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:07.208590    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:07.208825 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:07.208741    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:07.338257 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:07.338153    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:15:07.338723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:07.338657    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"53af44d5aeeadc2ae087844d8697b318cafbbf4801842a5c15213f3029d0c745"}
Sep 18 13:15:08.208834 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:08.208729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:08.209016 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:08.208843    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:08.532934 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:08.532904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:15:08.533487 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:08.533470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:15:08.562885 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:08.562840    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nwbcf" podStartSLOduration=5.869568053 podStartE2EDuration="25.562825757s" totalImagesPullingTime="19.693257704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:06.368092029 +0000 UTC m=+23.737351411" watchObservedRunningTime="2026-09-18 13:15:08.562825757 +0000 UTC m=+25.932085142"
Sep 18 13:15:09.208640 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.208458    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:09.208815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.208540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:09.208815 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:09.208676    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:09.208815 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:09.208784    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:09.344291 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.344269    2564 generic.go:356] "Generic (PLEG): container finished" podID="011f5db6-2d23-4056-91ce-209f7ba685d7" containerID="beb2a0834b5055522de0875ad97d5524dfd58db7b361a68713155ddf7608881e" exitCode=0
Sep 18 13:15:09.344413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.344360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerDied","Data":"beb2a0834b5055522de0875ad97d5524dfd58db7b361a68713155ddf7608881e"}
Sep 18 13:15:09.347938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.347921    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:15:09.348362 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.348342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"6dc75499f679e4fcf66d1f05c8c1a114f1a207ecfedc45545929faf95cede4bd"}
Sep 18 13:15:09.348647 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:09.348635    2564 scope.go:117] "RemoveContainer" containerID="110458c5aef8cf4d02ef773f00b3c0c81a610e0136a174d41eeeb72c3d39ede0"
Sep 18 13:15:10.208113 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.208083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:10.208779 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:10.208222    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:10.352891 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.352707    2564 generic.go:356] "Generic (PLEG): container finished" podID="011f5db6-2d23-4056-91ce-209f7ba685d7" containerID="2181604fc5988a47512f012dedeff207246a09e0dc2a1df286841599460dea52" exitCode=0
Sep 18 13:15:10.353031 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.352780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerDied","Data":"2181604fc5988a47512f012dedeff207246a09e0dc2a1df286841599460dea52"}
Sep 18 13:15:10.357422 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.357400    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:15:10.358447 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.358210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" event={"ID":"23b9fa98-ef8e-4d95-a85d-7578c03c6e65","Type":"ContainerStarted","Data":"792000131b06c1ee5aad9dee58b6427d132464d39dd49017ef4d6ebcbfa2b7f8"}
Sep 18 13:15:10.359559 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.359532    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:15:10.359663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.359633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:15:10.359717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.359706    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:15:10.376302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.376279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:15:10.377048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.377031    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:15:10.406278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.406235    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n" podStartSLOduration=9.549560839 podStartE2EDuration="27.406222573s" totalImagesPullingTime="17.856661734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:10.404655348 +0000 UTC m=+27.773914743" watchObservedRunningTime="2026-09-18 13:15:10.406222573 +0000 UTC m=+27.775481963"
Sep 18 13:15:10.643008 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.642976    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f855x"]
Sep 18 13:15:10.643223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.643091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:10.643300 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:10.643227    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:10.645923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.645900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brm8b"]
Sep 18 13:15:10.646033 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.646003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:10.646122 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:10.646105    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:10.649880 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.649860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cm6rb"]
Sep 18 13:15:10.649975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:10.649944    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:10.650046 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:10.650026    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:11.362480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:11.362402    2564 generic.go:356] "Generic (PLEG): container finished" podID="011f5db6-2d23-4056-91ce-209f7ba685d7" containerID="74882781ccf0f75df6130f1e031487198dc730df79884f970cebe5bf906aabbb" exitCode=0
Sep 18 13:15:11.362806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:11.362471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerDied","Data":"74882781ccf0f75df6130f1e031487198dc730df79884f970cebe5bf906aabbb"}
Sep 18 13:15:12.208924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:12.208889    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:12.208924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:12.208924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:12.209300 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:12.209008    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:12.209300 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:12.209055    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:12.209300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:12.209094    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:12.209300 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:12.209214    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:13.585793 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:13.585723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:15:13.586268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:13.585844    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 13:15:13.586563 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:13.586504    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8d5kd"
Sep 18 13:15:14.208930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:14.208884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:14.209103 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:14.208993    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:14.209103 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:14.209002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:14.209103 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:14.209000    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:14.209103 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:14.209093    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:14.209324 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:14.209164    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:16.208837 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.208808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:16.209267 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.208899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:16.209267 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.208912    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cm6rb" podUID="0e86b942-00ad-4dec-8a3c-d888481f1d6c"
Sep 18 13:15:16.209267 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.208973    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f855x" podUID="3b7d6d82-0974-4bde-83b4-1199b59617b4"
Sep 18 13:15:16.209267 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.209020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:16.209267 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.209096    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-brm8b" podUID="3a09ae84-dbc8-4957-b9b6-d8eaf219489f"
Sep 18 13:15:16.798370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.798212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:16.798473 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.798300    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:15:16.798473 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.798426    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret podName:3b7d6d82-0974-4bde-83b4-1199b59617b4 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.798410004 +0000 UTC m=+66.167669364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret") pod "global-pull-secret-syncer-f855x" (UID: "3b7d6d82-0974-4bde-83b4-1199b59617b4") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:15:16.899134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.899111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:16.899261 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.899245    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:15:16.899307 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.899295    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.899282613 +0000 UTC m=+66.268541973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:15:16.907317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.907301    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-225.ec2.internal" event="NodeReady"
Sep 18 13:15:16.907382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.907378    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 13:15:16.979955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.979934    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6df49b7874-mwchc"]
Sep 18 13:15:16.999369 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:16.999348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:16.999497 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.999483    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:15:16.999562 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.999504    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:15:16.999562 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.999517    2564 projected.go:196] Error preparing data for projected volume kube-api-access-62x4b for pod openshift-network-diagnostics/network-check-target-cm6rb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:15:16.999666 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:16.999564    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b podName:0e86b942-00ad-4dec-8a3c-d888481f1d6c nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.999550348 +0000 UTC m=+66.368809712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-62x4b" (UniqueName: "kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b") pod "network-check-target-cm6rb" (UID: "0e86b942-00ad-4dec-8a3c-d888481f1d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:15:17.003058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.003042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.008434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.008416    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 13:15:17.009225 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.009186    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 13:15:17.009312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.009265    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 13:15:17.009838 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.009822    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w5nbx\""
Sep 18 13:15:17.030720 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.030701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df49b7874-mwchc"]
Sep 18 13:15:17.031637 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.031620    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 13:15:17.032275 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.032257    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kq7gj"]
Sep 18 13:15:17.057150 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.057107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.061793 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.061775    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 13:15:17.061875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.061813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5qlvl\""
Sep 18 13:15:17.061875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.061847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 13:15:17.063339 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.063131    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4smz"]
Sep 18 13:15:17.087171 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.087150    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kq7gj"]
Sep 18 13:15:17.087283 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.087270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.090603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.090580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 13:15:17.092250 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.092038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 13:15:17.092973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.092954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8m5tk\""
Sep 18 13:15:17.093247 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.093226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4smz"]
Sep 18 13:15:17.093538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.093523    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 13:15:17.100322 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-bound-sa-token\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-trusted-ca\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-registry-certificates\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfb9ad4c-528d-4025-b717-868e02683c38-ca-trust-extracted\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-installation-pull-secrets\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-image-registry-private-configuration\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.100531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.100509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x9cj\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-kube-api-access-4x9cj\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.200939 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.200920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-trusted-ca\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.200945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-registry-certificates\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.200985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfb9ad4c-528d-4025-b717-868e02683c38-ca-trust-extracted\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-installation-pull-secrets\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f00e73f-7643-4db1-a96d-2bcf49f7237f-config-volume\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.201270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.201270 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.201086    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:17.201270 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.201100    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:17.201270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f00e73f-7643-4db1-a96d-2bcf49f7237f-tmp-dir\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.201270 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.201145    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:17.701128868 +0000 UTC m=+35.070388242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-image-registry-private-configuration\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x9cj\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-kube-api-access-4x9cj\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63858915-ce5e-476e-9d25-98a599268e93-cert\") pod \"ingress-canary-w4smz\" (UID: \"63858915-ce5e-476e-9d25-98a599268e93\") " pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg84j\" (UniqueName: \"kubernetes.io/projected/63858915-ce5e-476e-9d25-98a599268e93-kube-api-access-tg84j\") pod \"ingress-canary-w4smz\" (UID: \"63858915-ce5e-476e-9d25-98a599268e93\") " pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvrc7\" (UniqueName: \"kubernetes.io/projected/6f00e73f-7643-4db1-a96d-2bcf49f7237f-kube-api-access-tvrc7\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-bound-sa-token\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfb9ad4c-528d-4025-b717-868e02683c38-ca-trust-extracted\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.201899 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-registry-certificates\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.202020 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.201999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-trusted-ca\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.205055 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.205035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-installation-pull-secrets\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.205129 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.205088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-image-registry-private-configuration\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.215268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.215247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x9cj\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-kube-api-access-4x9cj\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.233164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.233143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-bound-sa-token\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.302279 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f00e73f-7643-4db1-a96d-2bcf49f7237f-config-volume\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.302363 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.302363 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f00e73f-7643-4db1-a96d-2bcf49f7237f-tmp-dir\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.302363 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63858915-ce5e-476e-9d25-98a599268e93-cert\") pod \"ingress-canary-w4smz\" (UID: \"63858915-ce5e-476e-9d25-98a599268e93\") " pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.302507 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.302387    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:17.302507 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.302433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:17.802418643 +0000 UTC m=+35.171678011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:17.302507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg84j\" (UniqueName: \"kubernetes.io/projected/63858915-ce5e-476e-9d25-98a599268e93-kube-api-access-tg84j\") pod \"ingress-canary-w4smz\" (UID: \"63858915-ce5e-476e-9d25-98a599268e93\") " pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.302507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvrc7\" (UniqueName: \"kubernetes.io/projected/6f00e73f-7643-4db1-a96d-2bcf49f7237f-kube-api-access-tvrc7\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.302713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f00e73f-7643-4db1-a96d-2bcf49f7237f-tmp-dir\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.302855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.302834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f00e73f-7643-4db1-a96d-2bcf49f7237f-config-volume\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.304334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.304317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63858915-ce5e-476e-9d25-98a599268e93-cert\") pod \"ingress-canary-w4smz\" (UID: \"63858915-ce5e-476e-9d25-98a599268e93\") " pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.314310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.314262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg84j\" (UniqueName: \"kubernetes.io/projected/63858915-ce5e-476e-9d25-98a599268e93-kube-api-access-tg84j\") pod \"ingress-canary-w4smz\" (UID: \"63858915-ce5e-476e-9d25-98a599268e93\") " pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.319536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.319517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvrc7\" (UniqueName: \"kubernetes.io/projected/6f00e73f-7643-4db1-a96d-2bcf49f7237f-kube-api-access-tvrc7\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.359629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.359605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:17.383752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.383733    2564 generic.go:356] "Generic (PLEG): container finished" podID="011f5db6-2d23-4056-91ce-209f7ba685d7" containerID="375c2163acc93656ff4a1f8142a144a04885121b2c9a31684c184218fb7681b8" exitCode=0
Sep 18 13:15:17.383838 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.383776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerDied","Data":"375c2163acc93656ff4a1f8142a144a04885121b2c9a31684c184218fb7681b8"}
Sep 18 13:15:17.395322 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.395306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4smz"
Sep 18 13:15:17.570522 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.570493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:17.706400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.706380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:17.706533 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.706516    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:17.706578 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.706534    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:17.706613 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.706581    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:18.706567373 +0000 UTC m=+36.075826766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:17.726155 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.726097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4smz"]
Sep 18 13:15:17.728246 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:15:17.728223    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63858915_ce5e_476e_9d25_98a599268e93.slice/crio-74bc37258bfd64df0273fe9b335b002f662dd590288972e45ffd8147deb63ac1 WatchSource:0}: Error finding container 74bc37258bfd64df0273fe9b335b002f662dd590288972e45ffd8147deb63ac1: Status 404 returned error can't find the container with id 74bc37258bfd64df0273fe9b335b002f662dd590288972e45ffd8147deb63ac1
Sep 18 13:15:17.807123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:17.807103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:17.807227 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.807188    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:17.807278 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:17.807263    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:18.807250796 +0000 UTC m=+36.176510156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:18.137205 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.137149    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:18.208553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.208528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:18.208662 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.208646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:18.208906 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.208888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:18.213978 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.213962    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crtpr\""
Sep 18 13:15:18.214662 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.214507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:15:18.214662 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.214510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4rmbt\""
Sep 18 13:15:18.215105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.215084    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:15:18.215902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.215880    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:15:18.216596 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.216461    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:15:18.249885 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.249862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:18.387683 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.387620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4smz" event={"ID":"63858915-ce5e-476e-9d25-98a599268e93","Type":"ContainerStarted","Data":"74bc37258bfd64df0273fe9b335b002f662dd590288972e45ffd8147deb63ac1"}
Sep 18 13:15:18.391302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.391274    2564 generic.go:356] "Generic (PLEG): container finished" podID="011f5db6-2d23-4056-91ce-209f7ba685d7" containerID="a5568aa090615d4fc0ca58d6d828b96cd8863ca0c66376fd90374b47661f0031" exitCode=0
Sep 18 13:15:18.391401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.391315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerDied","Data":"a5568aa090615d4fc0ca58d6d828b96cd8863ca0c66376fd90374b47661f0031"}
Sep 18 13:15:18.713590 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.713359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:18.713691 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:18.713410    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:18.713691 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:18.713619    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:18.713691 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:18.713669    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:20.713652593 +0000 UTC m=+38.082911952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:18.813900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:18.813868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:18.814046 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:18.814027    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:18.814115 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:18.814098    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:20.814077486 +0000 UTC m=+38.183336851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:19.398464 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:19.398430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" event={"ID":"011f5db6-2d23-4056-91ce-209f7ba685d7","Type":"ContainerStarted","Data":"bdd88b9d1a981acb1f95af7d5ca5964cc17ee46ed432887956593aaa91151629"}
Sep 18 13:15:19.443169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:19.443118    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d7pzx" podStartSLOduration=7.755877967 podStartE2EDuration="36.443099659s" totalImagesPullingTime="28.687221692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:19.441478975 +0000 UTC m=+36.810738370" watchObservedRunningTime="2026-09-18 13:15:19.443099659 +0000 UTC m=+36.812359042"
Sep 18 13:15:19.491697 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:19.491663    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:19.750500 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:19.750473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:19.908469 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:19.908433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:20.401975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:20.401936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4smz" event={"ID":"63858915-ce5e-476e-9d25-98a599268e93","Type":"ContainerStarted","Data":"37ea565106428a0090e740cf1283c56f978eaa0e07b5d08e001fabe091f82f4f"}
Sep 18 13:15:20.423158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:20.423059    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4smz" podStartSLOduration=1.9438276289999998 podStartE2EDuration="4.423014196s" totalImagesPullingTime="2.479186567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:20.421824601 +0000 UTC m=+37.791083984" watchObservedRunningTime="2026-09-18 13:15:20.423014196 +0000 UTC m=+37.792273578"
Sep 18 13:15:20.725507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:20.725425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:20.725632 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:20.725564    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:20.725632 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:20.725581    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:20.725632 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:20.725631    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:24.725617255 +0000 UTC m=+42.094876615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:20.826175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:20.826146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:20.826335 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:20.826293    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:20.826381 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:20.826361    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:24.826346316 +0000 UTC m=+42.195605676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:22.041597 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:22.041566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:22.156913 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:22.156884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:24.752248 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:24.752218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:24.752581 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:24.752317    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:24.752581 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:24.752329    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:24.752581 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:24.752371    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:32.752359093 +0000 UTC m=+50.121618454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:24.852716 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:24.852687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:24.852816 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:24.852799    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:24.852853 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:24.852839    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:32.852827879 +0000 UTC m=+50.222087238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:26.399740 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:26.399707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:26.544852 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:26.544822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:26.697927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:26.697857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:26.820703 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:26.820672    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:26.930115 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:26.930092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:27.284828 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:27.284805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:27.384085 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:27.384042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:28.603650 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:28.603630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:28.691840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:28.691818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:29.229918 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:29.229876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:31.917867 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:31.917835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:32.023576 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:32.023553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:32.807645 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:32.807615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:32.807743 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:32.807722    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:32.807743 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:32.807734    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:32.807810 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:32.807793    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.807780024 +0000 UTC m=+66.177039384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:32.908116 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:32.908090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:32.908235 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:32.908184    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:32.908280 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:32.908240    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.908226901 +0000 UTC m=+66.277486278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:33.054285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.054264    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b7d894bd-qg4wn"]
Sep 18 13:15:33.087589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.087571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.094095 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094077    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 13:15:33.094182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094101    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 13:15:33.094182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094128    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 13:15:33.094182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094079    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 13:15:33.094182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 13:15:33.094406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9jdq2\""
Sep 18 13:15:33.094406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.094364    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 13:15:33.124078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.124055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b7d894bd-qg4wn"]
Sep 18 13:15:33.209770 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.209747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.209855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.209772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4h75\" (UniqueName: \"kubernetes.io/projected/60f23438-f412-408c-9cc5-fcdc68f56508-kube-api-access-b4h75\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.209855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.209795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-stats-auth\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.209923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.209875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-default-certificate\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.209923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.209902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.258224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.258182    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-dfqt9"]
Sep 18 13:15:33.271656 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.271643    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.309621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.309571    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"]
Sep 18 13:15:33.311725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.311040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.311725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.311083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4h75\" (UniqueName: \"kubernetes.io/projected/60f23438-f412-408c-9cc5-fcdc68f56508-kube-api-access-b4h75\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.311725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.311215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-stats-auth\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.311725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.311351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-default-certificate\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.311725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.311381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.311725 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.311544    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:33.811527204 +0000 UTC m=+51.180786570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : configmap references non-existent config key: service-ca.crt
Sep 18 13:15:33.313224 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.311855    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 13:15:33.313224 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.311923    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:33.81190543 +0000 UTC m=+51.181164792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : secret "router-metrics-certs-default" not found
Sep 18 13:15:33.313224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.312453    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 13:15:33.313224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.312683    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 18 13:15:33.313549 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.313306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fxcwl\""
Sep 18 13:15:33.314127 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.313929    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 13:15:33.314127 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.313950    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 18 13:15:33.317352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.317330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-stats-auth\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.317429 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.317334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-default-certificate\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.327283 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.327265    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:33.335346 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.335322    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 18 13:15:33.335584 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.335553    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 18 13:15:33.335691 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.335654    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x9c5h\""
Sep 18 13:15:33.336420 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.336403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-dfqt9"]
Sep 18 13:15:33.339377 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.339361    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 18 13:15:33.365550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.365524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4h75\" (UniqueName: \"kubernetes.io/projected/60f23438-f412-408c-9cc5-fcdc68f56508-kube-api-access-b4h75\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.372302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.372280    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"]
Sep 18 13:15:33.412287 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.412259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2snbg\" (UniqueName: \"kubernetes.io/projected/9cef1c8e-6903-45bb-b619-b5e9f81df344-kube-api-access-2snbg\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.412287 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.412310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cef1c8e-6903-45bb-b619-b5e9f81df344-serving-cert\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.412483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.412449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cef1c8e-6903-45bb-b619-b5e9f81df344-snapshots\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.412648 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.412630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cef1c8e-6903-45bb-b619-b5e9f81df344-tmp\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.412726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.412690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cef1c8e-6903-45bb-b619-b5e9f81df344-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.412781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.412741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cef1c8e-6903-45bb-b619-b5e9f81df344-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.513943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.513921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cef1c8e-6903-45bb-b619-b5e9f81df344-snapshots\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514028 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.513954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cef1c8e-6903-45bb-b619-b5e9f81df344-tmp\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514028 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.513971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cef1c8e-6903-45bb-b619-b5e9f81df344-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514028 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.513988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cef1c8e-6903-45bb-b619-b5e9f81df344-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514135 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72487d2c-ebc9-4257-8625-6aa9172da029-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:33.514209 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2snbg\" (UniqueName: \"kubernetes.io/projected/9cef1c8e-6903-45bb-b619-b5e9f81df344-kube-api-access-2snbg\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514273 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:33.514325 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cef1c8e-6903-45bb-b619-b5e9f81df344-serving-cert\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514325 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cef1c8e-6903-45bb-b619-b5e9f81df344-tmp\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514594 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9cef1c8e-6903-45bb-b619-b5e9f81df344-snapshots\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514648 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cef1c8e-6903-45bb-b619-b5e9f81df344-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.514716 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.514682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cef1c8e-6903-45bb-b619-b5e9f81df344-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.516178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.516161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cef1c8e-6903-45bb-b619-b5e9f81df344-serving-cert\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.527688 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.527670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2snbg\" (UniqueName: \"kubernetes.io/projected/9cef1c8e-6903-45bb-b619-b5e9f81df344-kube-api-access-2snbg\") pod \"insights-operator-6f9c644dd9-dfqt9\" (UID: \"9cef1c8e-6903-45bb-b619-b5e9f81df344\") " pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.579828 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.579789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9"
Sep 18 13:15:33.615063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.615049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72487d2c-ebc9-4257-8625-6aa9172da029-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:33.615114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.615091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:33.615178 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.615167    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:15:33.615236 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.615227    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert podName:72487d2c-ebc9-4257-8625-6aa9172da029 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:34.11521504 +0000 UTC m=+51.484474400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-m5p8x" (UID: "72487d2c-ebc9-4257-8625-6aa9172da029") : secret "networking-console-plugin-cert" not found
Sep 18 13:15:33.615629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.615614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72487d2c-ebc9-4257-8625-6aa9172da029-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:33.793461 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.793414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:33.816424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.816401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.816492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.816446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:33.816576 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.816563    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:34.816547013 +0000 UTC m=+52.185806383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : configmap references non-existent config key: service-ca.crt
Sep 18 13:15:33.816626 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.816601    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 13:15:33.816667 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:33.816662    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:34.816649888 +0000 UTC m=+52.185909248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : secret "router-metrics-certs-default" not found
Sep 18 13:15:33.902617 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.902597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-dfqt9"]
Sep 18 13:15:33.905040 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:15:33.905019    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cef1c8e_6903_45bb_b619_b5e9f81df344.slice/crio-6e419036ab00a418d70980b66a2ab0d2b1883cc5633a673b3ba3bf6501466a62 WatchSource:0}: Error finding container 6e419036ab00a418d70980b66a2ab0d2b1883cc5633a673b3ba3bf6501466a62: Status 404 returned error can't find the container with id 6e419036ab00a418d70980b66a2ab0d2b1883cc5633a673b3ba3bf6501466a62
Sep 18 13:15:33.965975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:33.965916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:34.119016 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:34.118993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:34.119294 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:34.119124    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:15:34.119294 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:34.119169    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert podName:72487d2c-ebc9-4257-8625-6aa9172da029 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:35.119157418 +0000 UTC m=+52.488416783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-m5p8x" (UID: "72487d2c-ebc9-4257-8625-6aa9172da029") : secret "networking-console-plugin-cert" not found
Sep 18 13:15:34.434858 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:34.434831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9" event={"ID":"9cef1c8e-6903-45bb-b619-b5e9f81df344","Type":"ContainerStarted","Data":"6e419036ab00a418d70980b66a2ab0d2b1883cc5633a673b3ba3bf6501466a62"}
Sep 18 13:15:34.824045 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:34.824011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:34.824189 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:34.824078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:34.824189 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:34.824184    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 13:15:34.824328 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:34.824217    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:36.824178078 +0000 UTC m=+54.193437447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : configmap references non-existent config key: service-ca.crt
Sep 18 13:15:34.824328 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:34.824267    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:36.824249943 +0000 UTC m=+54.193509314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : secret "router-metrics-certs-default" not found
Sep 18 13:15:35.126783 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:35.126719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:35.127095 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:35.126855    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:15:35.127095 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:35.126908    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert podName:72487d2c-ebc9-4257-8625-6aa9172da029 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:37.126892148 +0000 UTC m=+54.496151514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-m5p8x" (UID: "72487d2c-ebc9-4257-8625-6aa9172da029") : secret "networking-console-plugin-cert" not found
Sep 18 13:15:36.441636 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:36.441603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9" event={"ID":"9cef1c8e-6903-45bb-b619-b5e9f81df344","Type":"ContainerStarted","Data":"a80a505c32e646c69281bd35eb1f33c52b155ccb990fcb199204f14af3eb6999"}
Sep 18 13:15:36.467929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:36.467882    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9" podStartSLOduration=1.516293513 podStartE2EDuration="3.467870457s" totalImagesPullingTime="1.951576944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:36.467691991 +0000 UTC m=+53.836951374" watchObservedRunningTime="2026-09-18 13:15:36.467870457 +0000 UTC m=+53.837129839"
Sep 18 13:15:36.839920 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:36.839894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:36.840041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:36.839935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:36.840082 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:36.840035    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:40.840019541 +0000 UTC m=+58.209278901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : configmap references non-existent config key: service-ca.crt
Sep 18 13:15:36.840082 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:36.840075    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 13:15:36.840150 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:36.840111    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:40.840100112 +0000 UTC m=+58.209359472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : secret "router-metrics-certs-default" not found
Sep 18 13:15:37.142882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.142815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:37.143015 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:37.142958    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:15:37.143058 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:37.143027    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert podName:72487d2c-ebc9-4257-8625-6aa9172da029 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:41.143011893 +0000 UTC m=+58.512271269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-m5p8x" (UID: "72487d2c-ebc9-4257-8625-6aa9172da029") : secret "networking-console-plugin-cert" not found
Sep 18 13:15:37.257012 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.256979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:37.263159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.263135    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ptnxt"]
Sep 18 13:15:37.266292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.266275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.269317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.269301    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 13:15:37.269659 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.269644    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2lqc\""
Sep 18 13:15:37.270663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.270643    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 13:15:37.337142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.337116    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ptnxt"]
Sep 18 13:15:37.409945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.409895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:37.444361 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.444344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9be544d-af74-4615-98fb-adb0a7cdd9ec-data-volume\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.444627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.444370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22r5j\" (UniqueName: \"kubernetes.io/projected/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-api-access-22r5j\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.444627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.444386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9be544d-af74-4615-98fb-adb0a7cdd9ec-crio-socket\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.444627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.444405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.444627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.444509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545016 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.544995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22r5j\" (UniqueName: \"kubernetes.io/projected/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-api-access-22r5j\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.545023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9be544d-af74-4615-98fb-adb0a7cdd9ec-crio-socket\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.545055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545185 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.545109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9be544d-af74-4615-98fb-adb0a7cdd9ec-crio-socket\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545185 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:37.545127    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:15:37.545185 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:37.545180    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:38.04516701 +0000 UTC m=+55.414426370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : configmap "kube-rbac-proxy" not found
Sep 18 13:15:37.545333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.545272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.545398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9be544d-af74-4615-98fb-adb0a7cdd9ec-data-volume\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.545483 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:37.545467    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:37.545539 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:37.545530    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:38.045513741 +0000 UTC m=+55.414773125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:37.545632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.545619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9be544d-af74-4615-98fb-adb0a7cdd9ec-data-volume\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:37.562616 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:37.562599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22r5j\" (UniqueName: \"kubernetes.io/projected/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-api-access-22r5j\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:38.050035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:38.050007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:38.050237 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:38.050067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:38.050237 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:38.050104    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:15:38.050237 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:38.050155    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:39.050142983 +0000 UTC m=+56.419402343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : configmap "kube-rbac-proxy" not found
Sep 18 13:15:38.050237 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:38.050221    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:38.050376 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:38.050260    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:39.050250431 +0000 UTC m=+56.419509791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:38.511300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:38.511281    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9f9fm_6b6e712a-ca30-4bab-aeb4-ec3506cd5af5/dns-node-resolver/0.log"
Sep 18 13:15:39.057932 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:39.057907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:39.058035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:39.057959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:39.058035 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:39.058011    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:15:39.058107 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:39.058044    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:39.058107 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:39.058057    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:41.058044007 +0000 UTC m=+58.427303367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : configmap "kube-rbac-proxy" not found
Sep 18 13:15:39.058107 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:39.058080    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:41.05806946 +0000 UTC m=+58.427328819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:39.717310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:39.717286    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s4jt7_813df9b5-73da-4639-9d03-550391e4313a/node-ca/0.log"
Sep 18 13:15:39.874010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:39.873987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:39.982220 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:39.982151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:40.525255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.525233    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4smz_63858915-ce5e-476e-9d25-98a599268e93/serve-healthcheck-canary/0.log"
Sep 18 13:15:40.525505 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.525485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:40.636847 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.636820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:40.735155 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.735127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:40.854172 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.854125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:40.870240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.870217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:40.870326 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:40.870254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:40.870368 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:40.870350    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 13:15:40.870401 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:40.870369    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.870352986 +0000 UTC m=+66.239612359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : configmap references non-existent config key: service-ca.crt
Sep 18 13:15:40.870401 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:40.870387    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:48.870377059 +0000 UTC m=+66.239636419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : secret "router-metrics-certs-default" not found
Sep 18 13:15:41.072009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.071989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:41.072097 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.072085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:41.072141 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:41.072110    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:41.072175 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:41.072141    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:15:41.072175 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:41.072153    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:45.072141642 +0000 UTC m=+62.441401002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:41.072262 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:41.072176    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:45.072165561 +0000 UTC m=+62.441424921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : configmap "kube-rbac-proxy" not found
Sep 18 13:15:41.075041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.075021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:41.172966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.172915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:41.173042 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:41.173028    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:15:41.173079 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:41.173069    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert podName:72487d2c-ebc9-4257-8625-6aa9172da029 nodeName:}" failed. No retries permitted until 2026-09-18 13:15:49.173058481 +0000 UTC m=+66.542317840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-m5p8x" (UID: "72487d2c-ebc9-4257-8625-6aa9172da029") : secret "networking-console-plugin-cert" not found
Sep 18 13:15:41.208036 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.208016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:41.497537 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.497511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:41.595501 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:41.595472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:42.295588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:42.295567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:42.374383 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:42.374367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvg6n"
Sep 18 13:15:42.395331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:42.395300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:42.648520 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:42.648450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:42.748989 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:42.748966    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:42.871946 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:42.871926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:43.265768 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:43.265739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:43.523550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:43.523496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:43.713419 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:43.713399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:44.902890 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:44.902859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:45.103833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:45.103808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:45.103957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:45.103864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:45.103957 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:45.103921    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:15:45.104026 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:45.103969    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:53.103956661 +0000 UTC m=+70.473216027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : configmap "kube-rbac-proxy" not found
Sep 18 13:15:45.104082 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:45.104067    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:45.104126 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:45.104117    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:15:53.104104406 +0000 UTC m=+70.473363770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:46.317169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:46.317143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:46.440044 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:46.440024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:46.616797 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:46.616743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:46.873992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:46.873937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:47.300448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:47.300420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:47.816780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:47.816750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:48.412607 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.412583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:48.645285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.645261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:48.834612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.834591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:48.834897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.834676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:15:48.834897 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.834767    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:15:48.834897 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.834778    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df49b7874-mwchc: secret "image-registry-tls" not found
Sep 18 13:15:48.834897 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.834818    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls podName:bfb9ad4c-528d-4025-b717-868e02683c38 nodeName:}" failed. No retries permitted until 2026-09-18 13:16:20.834807102 +0000 UTC m=+98.204066462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls") pod "image-registry-6df49b7874-mwchc" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38") : secret "image-registry-tls" not found
Sep 18 13:15:48.837743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.837728    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:15:48.846811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.846792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b7d6d82-0974-4bde-83b4-1199b59617b4-original-pull-secret\") pod \"global-pull-secret-syncer-f855x\" (UID: \"3b7d6d82-0974-4bde-83b4-1199b59617b4\") " pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:48.853670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.853647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:48.934932 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.934906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:48.935024 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.934989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:15:48.935070 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.935040    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 13:15:48.935112 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.935097    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:15:48.935112 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.935103    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:16:04.935086865 +0000 UTC m=+82.304346241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : secret "router-metrics-certs-default" not found
Sep 18 13:15:48.935186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.935043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:15:48.935186 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.935138    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls podName:6f00e73f-7643-4db1-a96d-2bcf49f7237f nodeName:}" failed. No retries permitted until 2026-09-18 13:16:20.935128062 +0000 UTC m=+98.304387444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls") pod "dns-default-kq7gj" (UID: "6f00e73f-7643-4db1-a96d-2bcf49f7237f") : secret "dns-default-metrics-tls" not found
Sep 18 13:15:48.935186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.935172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:15:48.935321 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.935280    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle podName:60f23438-f412-408c-9cc5-fcdc68f56508 nodeName:}" failed. No retries permitted until 2026-09-18 13:16:04.935269649 +0000 UTC m=+82.304529053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle") pod "router-default-6b7d894bd-qg4wn" (UID: "60f23438-f412-408c-9cc5-fcdc68f56508") : configmap references non-existent config key: service-ca.crt
Sep 18 13:15:48.939946 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:48.939933    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:15:48.945397 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.945382    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 13:15:48.945470 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:48.945438    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs podName:3a09ae84-dbc8-4957-b9b6-d8eaf219489f nodeName:}" failed. No retries permitted until 2026-09-18 13:16:52.945425805 +0000 UTC m=+130.314685165 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs") pod "network-metrics-daemon-brm8b" (UID: "3a09ae84-dbc8-4957-b9b6-d8eaf219489f") : secret "metrics-daemon-secret" not found
Sep 18 13:15:49.022152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.022127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:49.036067 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.036047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:49.038973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.038957    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:15:49.049670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.049655    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:15:49.060178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.060158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62x4b\" (UniqueName: \"kubernetes.io/projected/0e86b942-00ad-4dec-8a3c-d888481f1d6c-kube-api-access-62x4b\") pod \"network-check-target-cm6rb\" (UID: \"0e86b942-00ad-4dec-8a3c-d888481f1d6c\") " pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:49.125414 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.125364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crtpr\""
Sep 18 13:15:49.127483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.127469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f855x"
Sep 18 13:15:49.132740 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.132712    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:49.238260 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.238234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:15:49.238382 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:49.238287    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:15:49.238382 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:49.238350    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert podName:72487d2c-ebc9-4257-8625-6aa9172da029 nodeName:}" failed. No retries permitted until 2026-09-18 13:16:05.238335757 +0000 UTC m=+82.607595117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-m5p8x" (UID: "72487d2c-ebc9-4257-8625-6aa9172da029") : secret "networking-console-plugin-cert" not found
Sep 18 13:15:49.409061 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.408992    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f855x"]
Sep 18 13:15:49.412715 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:15:49.412679    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7d6d82_0974_4bde_83b4_1199b59617b4.slice/crio-c998be36069a331015c14bda3e820f9193e96c235e4005b000db2e672faad793 WatchSource:0}: Error finding container c998be36069a331015c14bda3e820f9193e96c235e4005b000db2e672faad793: Status 404 returned error can't find the container with id c998be36069a331015c14bda3e820f9193e96c235e4005b000db2e672faad793
Sep 18 13:15:49.435619 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.435594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cm6rb"]
Sep 18 13:15:49.438220 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:15:49.438188    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e86b942_00ad_4dec_8a3c_d888481f1d6c.slice/crio-998dcc3108a05cb9623f3106900c88b035b601cf5a0f74804b1472de5e7d7390 WatchSource:0}: Error finding container 998dcc3108a05cb9623f3106900c88b035b601cf5a0f74804b1472de5e7d7390: Status 404 returned error can't find the container with id 998dcc3108a05cb9623f3106900c88b035b601cf5a0f74804b1472de5e7d7390
Sep 18 13:15:49.470600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.470578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f855x" event={"ID":"3b7d6d82-0974-4bde-83b4-1199b59617b4","Type":"ContainerStarted","Data":"c998be36069a331015c14bda3e820f9193e96c235e4005b000db2e672faad793"}
Sep 18 13:15:49.471659 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.471641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cm6rb" event={"ID":"0e86b942-00ad-4dec-8a3c-d888481f1d6c","Type":"ContainerStarted","Data":"998dcc3108a05cb9623f3106900c88b035b601cf5a0f74804b1472de5e7d7390"}
Sep 18 13:15:49.995892 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:49.995857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.117274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.117246    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.301145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.301075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.404425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.404386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.517470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.517429    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.670163 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.670093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.825204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.825156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:50.964728 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:50.964638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:51.103480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:51.103438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:51.831355 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:51.831311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:52.433714 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:52.433674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:52.591877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:52.591829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:52.718292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:52.718218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:52.827313 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:52.827277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:53.171508 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:53.171469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:53.171694 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:53.171638    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:53.171758 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:15:53.171715    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls podName:f9be544d-af74-4615-98fb-adb0a7cdd9ec nodeName:}" failed. No retries permitted until 2026-09-18 13:16:09.171694168 +0000 UTC m=+86.540953528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ptnxt" (UID: "f9be544d-af74-4615-98fb-adb0a7cdd9ec") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:15:53.171758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:53.171740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:53.172342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:53.172315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9be544d-af74-4615-98fb-adb0a7cdd9ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:15:53.297486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:53.297434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:54.002134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.002107    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:54.406909 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.406878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:54.486342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.486312    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f855x" event={"ID":"3b7d6d82-0974-4bde-83b4-1199b59617b4","Type":"ContainerStarted","Data":"10c1f8d2e86b4b02a0c86ff5566302b3c32e61e739cf753d2fa7ccd9084e3ed6"}
Sep 18 13:15:54.487794 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.487772    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cm6rb" event={"ID":"0e86b942-00ad-4dec-8a3c-d888481f1d6c","Type":"ContainerStarted","Data":"985ef4508a0955573c8264e2ce833387049310e5ab362af9e219aaa98c467d25"}
Sep 18 13:15:54.487888 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.487824    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:15:54.503521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.503481    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f855x" podStartSLOduration=66.992629104 podStartE2EDuration="1m11.503468986s" totalImagesPullingTime="4.510839882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:54.502880035 +0000 UTC m=+71.872139418" watchObservedRunningTime="2026-09-18 13:15:54.503468986 +0000 UTC m=+71.872728404"
Sep 18 13:15:54.521867 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.521829    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cm6rb" podStartSLOduration=67.041763711 podStartE2EDuration="1m11.52181812s" totalImagesPullingTime="4.480054409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:15:54.521705361 +0000 UTC m=+71.890964743" watchObservedRunningTime="2026-09-18 13:15:54.52181812 +0000 UTC m=+71.891077496"
Sep 18 13:15:54.594923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.594899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:54.793823 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.793807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:54.991085 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:54.991038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:56.038434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:56.038396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:56.429390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:56.429331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:56.609793 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:56.609766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:56.821333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:56.821313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:57.016577 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:57.016541    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:57.939502 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:57.939477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:58.122169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:58.122148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:58.310945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:58.310914    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:58.455082 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:58.455057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:58.576695 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:58.576649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:58.958287 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:58.958228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:59.389134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:59.389111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:59.610542 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:59.610517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:15:59.892102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:15:59.892080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:00.429264 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:00.429238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:00.610724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:00.610703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:01.489886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:01.489862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:03.094180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:03.094135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:03.193078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:03.193048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:04.954396 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:04.954369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:04.954801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:04.954403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:04.954900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:04.954880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60f23438-f412-408c-9cc5-fcdc68f56508-service-ca-bundle\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:04.956999 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:04.956979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60f23438-f412-408c-9cc5-fcdc68f56508-metrics-certs\") pod \"router-default-6b7d894bd-qg4wn\" (UID: \"60f23438-f412-408c-9cc5-fcdc68f56508\") " pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:05.198570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.198548    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9jdq2\""
Sep 18 13:16:05.206860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.206825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:05.256801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.256730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:16:05.258965 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.258936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/72487d2c-ebc9-4257-8625-6aa9172da029-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-m5p8x\" (UID: \"72487d2c-ebc9-4257-8625-6aa9172da029\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:16:05.438375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.438352    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x9c5h\""
Sep 18 13:16:05.446538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.446524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"
Sep 18 13:16:05.482575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.482506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b7d894bd-qg4wn"]
Sep 18 13:16:05.486123 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:05.486103    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f23438_f412_408c_9cc5_fcdc68f56508.slice/crio-0bee562fc46595367a6c68ffbe34ea280a217b7ba480392376e0f2303484b819 WatchSource:0}: Error finding container 0bee562fc46595367a6c68ffbe34ea280a217b7ba480392376e0f2303484b819: Status 404 returned error can't find the container with id 0bee562fc46595367a6c68ffbe34ea280a217b7ba480392376e0f2303484b819
Sep 18 13:16:05.511882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.511848    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b7d894bd-qg4wn" event={"ID":"60f23438-f412-408c-9cc5-fcdc68f56508","Type":"ContainerStarted","Data":"0bee562fc46595367a6c68ffbe34ea280a217b7ba480392376e0f2303484b819"}
Sep 18 13:16:05.719764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:05.719670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x"]
Sep 18 13:16:05.724576 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:05.724549    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72487d2c_ebc9_4257_8625_6aa9172da029.slice/crio-39f84de9d9b5cd677cd2f4d312f8310d96f38b807278fb8f48b49e88235036c5 WatchSource:0}: Error finding container 39f84de9d9b5cd677cd2f4d312f8310d96f38b807278fb8f48b49e88235036c5: Status 404 returned error can't find the container with id 39f84de9d9b5cd677cd2f4d312f8310d96f38b807278fb8f48b49e88235036c5
Sep 18 13:16:06.516484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:06.516447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b7d894bd-qg4wn" event={"ID":"60f23438-f412-408c-9cc5-fcdc68f56508","Type":"ContainerStarted","Data":"c6c11d3131829beb56ebaf0bd954d8981af83efb9117c1c90b4bd25c1798381d"}
Sep 18 13:16:06.517670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:06.517645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x" event={"ID":"72487d2c-ebc9-4257-8625-6aa9172da029","Type":"ContainerStarted","Data":"39f84de9d9b5cd677cd2f4d312f8310d96f38b807278fb8f48b49e88235036c5"}
Sep 18 13:16:06.541397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:06.541300    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b7d894bd-qg4wn" podStartSLOduration=33.541284067 podStartE2EDuration="33.541284067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:06.540041711 +0000 UTC m=+83.909301094" watchObservedRunningTime="2026-09-18 13:16:06.541284067 +0000 UTC m=+83.910543450"
Sep 18 13:16:07.207187 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.207128    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:07.211278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.211261    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:07.504273 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.504247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:07.521738 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.521710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x" event={"ID":"72487d2c-ebc9-4257-8625-6aa9172da029","Type":"ContainerStarted","Data":"5acc79cbfbb95370777a93bdd9007c67ade904cfe65f3008ca04e5bf5d186c35"}
Sep 18 13:16:07.522102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.522085    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:07.523055 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.523042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b7d894bd-qg4wn"
Sep 18 13:16:07.543797 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.543757    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-m5p8x" podStartSLOduration=33.447770053 podStartE2EDuration="34.543744421s" totalImagesPullingTime="1.095974368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:07.543062142 +0000 UTC m=+84.912321515" watchObservedRunningTime="2026-09-18 13:16:07.543744421 +0000 UTC m=+84.913003833"
Sep 18 13:16:07.608165 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.608138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:07.712985 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.712964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:07.837268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.837216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:07.923854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:07.923833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:09.183011 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:09.182985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:16:09.185109 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:09.185091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9be544d-af74-4615-98fb-adb0a7cdd9ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ptnxt\" (UID: \"f9be544d-af74-4615-98fb-adb0a7cdd9ec\") " pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:16:09.377459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:09.377438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2lqc\""
Sep 18 13:16:09.385558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:09.385541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ptnxt"
Sep 18 13:16:09.655502 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:09.655478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ptnxt"]
Sep 18 13:16:09.658581 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:09.658559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9be544d_af74_4615_98fb_adb0a7cdd9ec.slice/crio-bfe31dd0342d0b1a589e788202c017dbd6f991d9ffa6d8481c61b59c0d724809 WatchSource:0}: Error finding container bfe31dd0342d0b1a589e788202c017dbd6f991d9ffa6d8481c61b59c0d724809: Status 404 returned error can't find the container with id bfe31dd0342d0b1a589e788202c017dbd6f991d9ffa6d8481c61b59c0d724809
Sep 18 13:16:10.533032 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.533000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptnxt" event={"ID":"f9be544d-af74-4615-98fb-adb0a7cdd9ec","Type":"ContainerStarted","Data":"113966396e0c6738551126d055d8d4ed7a8df48233ece76eaa25704411ec91b6"}
Sep 18 13:16:10.533317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.533074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptnxt" event={"ID":"f9be544d-af74-4615-98fb-adb0a7cdd9ec","Type":"ContainerStarted","Data":"5ebfdf582c1dfb73639f20d6f5392352598ff3274cb5f6c7fa360743741d4198"}
Sep 18 13:16:10.533317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.533094    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptnxt" event={"ID":"f9be544d-af74-4615-98fb-adb0a7cdd9ec","Type":"ContainerStarted","Data":"bfe31dd0342d0b1a589e788202c017dbd6f991d9ffa6d8481c61b59c0d724809"}
Sep 18 13:16:10.563428 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.563397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:10.662653 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.662596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:10.917020 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.916950    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"]
Sep 18 13:16:10.919779 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.919765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:10.925086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.925067    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 13:16:10.926034 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.926013    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 13:16:10.934114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.934095    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 13:16:10.937439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.937424    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 18 13:16:10.937931 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.937916    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5rhsw\""
Sep 18 13:16:10.941467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:10.941446    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"]
Sep 18 13:16:11.001882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.000816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl\" (UID: \"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.001882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.000864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pnrh\" (UniqueName: \"kubernetes.io/projected/bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4-kube-api-access-4pnrh\") pod \"managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl\" (UID: \"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.038287 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.038120    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"]
Sep 18 13:16:11.041447 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.041402    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-767f4c4885-9vtlc"]
Sep 18 13:16:11.041586 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.041534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:11.044383 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.044363    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.060141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.060121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 13:16:11.060273 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.060227    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 13:16:11.060413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.060397    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 13:16:11.062231 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.062210    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 13:16:11.062357 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.062305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 13:16:11.062436 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.062355    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 13:16:11.062642 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.062623    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 13:16:11.062763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.062625    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bx46m\""
Sep 18 13:16:11.073426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.073406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n9jrg\""
Sep 18 13:16:11.073675 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.073615    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 13:16:11.074792 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.074772    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"]
Sep 18 13:16:11.082375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.082353    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767f4c4885-9vtlc"]
Sep 18 13:16:11.090860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.090833    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 13:16:11.101457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl\" (UID: \"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.101554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pnrh\" (UniqueName: \"kubernetes.io/projected/bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4-kube-api-access-4pnrh\") pod \"managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl\" (UID: \"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.101554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-config\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.101554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-trusted-ca-bundle\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.101713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-oauth-serving-cert\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.101713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1882e4d7-a606-4172-bdce-43bc9f0ff879-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9lkxl\" (UID: \"1882e4d7-a606-4172-bdce-43bc9f0ff879\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:11.101713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-serving-cert\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.101713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-service-ca\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.101905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-oauth-config\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.101905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.101779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8kcm\" (UniqueName: \"kubernetes.io/projected/b72b1af5-2a83-47af-ba42-380f4cb199a1-kube-api-access-g8kcm\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.104178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.104158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl\" (UID: \"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.126423 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.126400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:11.133380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.133362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pnrh\" (UniqueName: \"kubernetes.io/projected/bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4-kube-api-access-4pnrh\") pod \"managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl\" (UID: \"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.202977 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.202906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-service-ca\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-oauth-config\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8kcm\" (UniqueName: \"kubernetes.io/projected/b72b1af5-2a83-47af-ba42-380f4cb199a1-kube-api-access-g8kcm\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203157 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-config\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-trusted-ca-bundle\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-oauth-serving-cert\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1882e4d7-a606-4172-bdce-43bc9f0ff879-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9lkxl\" (UID: \"1882e4d7-a606-4172-bdce-43bc9f0ff879\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:11.203737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-serving-cert\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.203737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-service-ca\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.204042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.203842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-config\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.204140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.204115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-trusted-ca-bundle\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.204499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.204462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-oauth-serving-cert\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.205674 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.205646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-oauth-config\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.205996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.205977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-serving-cert\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.206382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.206360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1882e4d7-a606-4172-bdce-43bc9f0ff879-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9lkxl\" (UID: \"1882e4d7-a606-4172-bdce-43bc9f0ff879\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:11.214464 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.214443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8kcm\" (UniqueName: \"kubernetes.io/projected/b72b1af5-2a83-47af-ba42-380f4cb199a1-kube-api-access-g8kcm\") pod \"console-767f4c4885-9vtlc\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") " pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.234507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.234481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:11.246295 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.246273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"
Sep 18 13:16:11.341491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.341462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:11.354206 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.354171    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:11.361342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.361313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:11.440761 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.440733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:11.518263 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.518212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl"]
Sep 18 13:16:11.662810 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:11.662779    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbea3e2c6_70fb_4f54_b9b4_f0d9b83935b4.slice/crio-393aedd5359b3ec8feeb0696cb3e3afb8af7f3acec2f22847a0d17a068198a2a WatchSource:0}: Error finding container 393aedd5359b3ec8feeb0696cb3e3afb8af7f3acec2f22847a0d17a068198a2a: Status 404 returned error can't find the container with id 393aedd5359b3ec8feeb0696cb3e3afb8af7f3acec2f22847a0d17a068198a2a
Sep 18 13:16:11.935758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.935733    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"]
Sep 18 13:16:11.938237 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:11.938211    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1882e4d7_a606_4172_bdce_43bc9f0ff879.slice/crio-efef30a07f78d7a9ae1eb6989b7997bd66a2424d532d9d2c3bb309da64d343b4 WatchSource:0}: Error finding container efef30a07f78d7a9ae1eb6989b7997bd66a2424d532d9d2c3bb309da64d343b4: Status 404 returned error can't find the container with id efef30a07f78d7a9ae1eb6989b7997bd66a2424d532d9d2c3bb309da64d343b4
Sep 18 13:16:11.939366 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:11.939332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767f4c4885-9vtlc"]
Sep 18 13:16:11.942320 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:11.942300    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72b1af5_2a83_47af_ba42_380f4cb199a1.slice/crio-177bb05387ab567db0552b7e65a41460603f74a2fb7d302d6a17ebc88c9e181b WatchSource:0}: Error finding container 177bb05387ab567db0552b7e65a41460603f74a2fb7d302d6a17ebc88c9e181b: Status 404 returned error can't find the container with id 177bb05387ab567db0552b7e65a41460603f74a2fb7d302d6a17ebc88c9e181b
Sep 18 13:16:12.559537 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:12.559494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767f4c4885-9vtlc" event={"ID":"b72b1af5-2a83-47af-ba42-380f4cb199a1","Type":"ContainerStarted","Data":"177bb05387ab567db0552b7e65a41460603f74a2fb7d302d6a17ebc88c9e181b"}
Sep 18 13:16:12.568175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:12.568107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl" event={"ID":"1882e4d7-a606-4172-bdce-43bc9f0ff879","Type":"ContainerStarted","Data":"efef30a07f78d7a9ae1eb6989b7997bd66a2424d532d9d2c3bb309da64d343b4"}
Sep 18 13:16:12.571170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:12.571111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ptnxt" event={"ID":"f9be544d-af74-4615-98fb-adb0a7cdd9ec","Type":"ContainerStarted","Data":"86033caf77a554d4dab90f36afa854292c73607967767f38599a8126b51201dc"}
Sep 18 13:16:12.574524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:12.574493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl" event={"ID":"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4","Type":"ContainerStarted","Data":"393aedd5359b3ec8feeb0696cb3e3afb8af7f3acec2f22847a0d17a068198a2a"}
Sep 18 13:16:12.592635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:12.592584    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ptnxt" podStartSLOduration=33.652621504 podStartE2EDuration="35.592567379s" totalImagesPullingTime="1.939945875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:15:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:12.59231745 +0000 UTC m=+89.961576834" watchObservedRunningTime="2026-09-18 13:16:12.592567379 +0000 UTC m=+89.961826762"
Sep 18 13:16:13.456564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:13.456447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:13.531577 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:13.531469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:14.556293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:14.556250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:14.650549 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:14.650464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:17.593188 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.593154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767f4c4885-9vtlc" event={"ID":"b72b1af5-2a83-47af-ba42-380f4cb199a1","Type":"ContainerStarted","Data":"7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d"}
Sep 18 13:16:17.594676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.594643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl" event={"ID":"1882e4d7-a606-4172-bdce-43bc9f0ff879","Type":"ContainerStarted","Data":"abb5e8920c3310311d0e7e2170ad6c1cfd4fb567738aa8b43bb2d1aa7bc08a56"}
Sep 18 13:16:17.594831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.594692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:17.596067 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.596045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl" event={"ID":"bea3e2c6-70fb-4f54-b9b4-f0d9b83935b4","Type":"ContainerStarted","Data":"cfbb784cebefffa5ceeb9b665b224b599e0fcb5dc4d792b6da5523d77b23dd22"}
Sep 18 13:16:17.599121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.599098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl"
Sep 18 13:16:17.632316 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.632253    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-767f4c4885-9vtlc" podStartSLOduration=2.334268357 podStartE2EDuration="7.632240989s" totalImagesPullingTime="5.297972632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:17.631516403 +0000 UTC m=+95.000775787" watchObservedRunningTime="2026-09-18 13:16:17.632240989 +0000 UTC m=+95.001500370"
Sep 18 13:16:17.694279 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:17.694241    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c9b8cff6-r6dzl" podStartSLOduration=2.181096806 podStartE2EDuration="7.694229832s" totalImagesPullingTime="5.513133026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:17.667419614 +0000 UTC m=+95.036678996" watchObservedRunningTime="2026-09-18 13:16:17.694229832 +0000 UTC m=+95.063489214"
Sep 18 13:16:18.119395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.119366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:18.265945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.265920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:18.717228 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.717183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:18.797439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.797402    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9lkxl" podStartSLOduration=4.572903952 podStartE2EDuration="8.79738795s" totalImagesPullingTime="4.224483998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:17.694367717 +0000 UTC m=+95.063627097" watchObservedRunningTime="2026-09-18 13:16:18.79738795 +0000 UTC m=+96.166647332"
Sep 18 13:16:18.797845 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.797831    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"]
Sep 18 13:16:18.800940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.800927    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.805676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.805657    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 18 13:16:18.805806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.805788    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 18 13:16:18.805806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.805798    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 13:16:18.805955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.805879    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 13:16:18.807148 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.807125    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 13:16:18.807273 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.807176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j9jn2\""
Sep 18 13:16:18.816731 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.816710    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"]
Sep 18 13:16:18.838122 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.838099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:18.863572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.863546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9pm\" (UniqueName: \"kubernetes.io/projected/241f85cb-a793-4570-8643-e5c916aafe2e-kube-api-access-kr9pm\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.863663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.863582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.863663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.863601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/241f85cb-a793-4570-8643-e5c916aafe2e-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.863663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.863639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.964506 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.964480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9pm\" (UniqueName: \"kubernetes.io/projected/241f85cb-a793-4570-8643-e5c916aafe2e-kube-api-access-kr9pm\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.964592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.964529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.964592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.964558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/241f85cb-a793-4570-8643-e5c916aafe2e-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.964711 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.964597    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.964760 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:18.964711    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 18 13:16:18.964812 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:18.964789    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-tls podName:241f85cb-a793-4570-8643-e5c916aafe2e nodeName:}" failed. No retries permitted until 2026-09-18 13:16:19.464762944 +0000 UTC m=+96.834022322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-4ctzp" (UID: "241f85cb-a793-4570-8643-e5c916aafe2e") : secret "prometheus-operator-tls" not found
Sep 18 13:16:18.965126 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.965108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/241f85cb-a793-4570-8643-e5c916aafe2e-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.966799 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.966778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:18.975987 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:18.975939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9pm\" (UniqueName: \"kubernetes.io/projected/241f85cb-a793-4570-8643-e5c916aafe2e-kube-api-access-kr9pm\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:19.137078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:19.137052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:19.279098 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:19.279071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:19.468449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:19.468425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:19.470500 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:19.470479    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/241f85cb-a793-4570-8643-e5c916aafe2e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4ctzp\" (UID: \"241f85cb-a793-4570-8643-e5c916aafe2e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:19.709004 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:19.708959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"
Sep 18 13:16:19.997790 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:19.997765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp"]
Sep 18 13:16:20.001106 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:20.001079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241f85cb_a793_4570_8643_e5c916aafe2e.slice/crio-1119b45695d130c3d4d55b8fab6ba0f06831e674d31c8709b98e4fcd96e8f08e WatchSource:0}: Error finding container 1119b45695d130c3d4d55b8fab6ba0f06831e674d31c8709b98e4fcd96e8f08e: Status 404 returned error can't find the container with id 1119b45695d130c3d4d55b8fab6ba0f06831e674d31c8709b98e4fcd96e8f08e
Sep 18 13:16:20.080178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.080154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:20.186290 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.186257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:20.605594 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.605556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp" event={"ID":"241f85cb-a793-4570-8643-e5c916aafe2e","Type":"ContainerStarted","Data":"1119b45695d130c3d4d55b8fab6ba0f06831e674d31c8709b98e4fcd96e8f08e"}
Sep 18 13:16:20.878353 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.878279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:20.880763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.880739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"image-registry-6df49b7874-mwchc\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") " pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:20.913496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.913466    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w5nbx\""
Sep 18 13:16:20.921602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.921581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:20.979041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.979015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:16:20.981255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:20.981229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f00e73f-7643-4db1-a96d-2bcf49f7237f-metrics-tls\") pod \"dns-default-kq7gj\" (UID: \"6f00e73f-7643-4db1-a96d-2bcf49f7237f\") " pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:16:21.267588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.267451    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5qlvl\""
Sep 18 13:16:21.275353 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.275333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:16:21.362323 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.362288    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:21.362471 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.362394    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:21.368466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.368443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:21.420688 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.420563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df49b7874-mwchc"]
Sep 18 13:16:21.423134 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:21.423111    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb9ad4c_528d_4025_b717_868e02683c38.slice/crio-b88e58f344e2f52fec212a9ed3909263ef5669f3fbd822eb33bb00cddcb068e9 WatchSource:0}: Error finding container b88e58f344e2f52fec212a9ed3909263ef5669f3fbd822eb33bb00cddcb068e9: Status 404 returned error can't find the container with id b88e58f344e2f52fec212a9ed3909263ef5669f3fbd822eb33bb00cddcb068e9
Sep 18 13:16:21.502435 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.502413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:21.559609 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.559568    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kq7gj"]
Sep 18 13:16:21.563771 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:21.563748    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f00e73f_7643_4db1_a96d_2bcf49f7237f.slice/crio-21215ecea11397c2e2d04383acdcfd9a8ee2bbc08436db8c6ab387f054872f32 WatchSource:0}: Error finding container 21215ecea11397c2e2d04383acdcfd9a8ee2bbc08436db8c6ab387f054872f32: Status 404 returned error can't find the container with id 21215ecea11397c2e2d04383acdcfd9a8ee2bbc08436db8c6ab387f054872f32
Sep 18 13:16:21.609571 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.609537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kq7gj" event={"ID":"6f00e73f-7643-4db1-a96d-2bcf49f7237f","Type":"ContainerStarted","Data":"21215ecea11397c2e2d04383acdcfd9a8ee2bbc08436db8c6ab387f054872f32"}
Sep 18 13:16:21.611300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.611276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp" event={"ID":"241f85cb-a793-4570-8643-e5c916aafe2e","Type":"ContainerStarted","Data":"ba1734cbbdb7934de0621c427c392042bf0948ac84283561bcf8b6cf4fe84158"}
Sep 18 13:16:21.611413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.611323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp" event={"ID":"241f85cb-a793-4570-8643-e5c916aafe2e","Type":"ContainerStarted","Data":"1ed92666a7ffb7d97c6b4bd5844916a834661a2e4d07e5f3fe3ed1daa3562323"}
Sep 18 13:16:21.613019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.612988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df49b7874-mwchc" event={"ID":"bfb9ad4c-528d-4025-b717-868e02683c38","Type":"ContainerStarted","Data":"ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3"}
Sep 18 13:16:21.613113 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.613022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df49b7874-mwchc" event={"ID":"bfb9ad4c-528d-4025-b717-868e02683c38","Type":"ContainerStarted","Data":"b88e58f344e2f52fec212a9ed3909263ef5669f3fbd822eb33bb00cddcb068e9"}
Sep 18 13:16:21.616868 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.616843    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:16:21.634182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.634140    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4ctzp" podStartSLOduration=2.445476071 podStartE2EDuration="3.6341264s" totalImagesPullingTime="1.188650329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:21.633902067 +0000 UTC m=+99.003161451" watchObservedRunningTime="2026-09-18 13:16:21.6341264 +0000 UTC m=+99.003385781"
Sep 18 13:16:21.697342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.697228    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6df49b7874-mwchc" podStartSLOduration=98.697207005 podStartE2EDuration="1m38.697207005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:21.696425457 +0000 UTC m=+99.065684839" watchObservedRunningTime="2026-09-18 13:16:21.697207005 +0000 UTC m=+99.066466379"
Sep 18 13:16:21.704167 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.704033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:21.787815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:21.787775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:22.617613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:22.617580    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:22.925284 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:22.925178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.151647 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.151597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.182307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.182247    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"]
Sep 18 13:16:23.185699 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.185682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.189511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.189492    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 18 13:16:23.189802 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.189784    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 18 13:16:23.189970 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.189952    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9qf8b\""
Sep 18 13:16:23.207036 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.207014    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"]
Sep 18 13:16:23.221254 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.221228    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wtgfr"]
Sep 18 13:16:23.224525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.224506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.227576 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.227558    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 13:16:23.227973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.227954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 13:16:23.228804 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.228777    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p6v7j\""
Sep 18 13:16:23.228899 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.228777    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 13:16:23.267051 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.267019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.297503 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v2qf\" (UniqueName: \"kubernetes.io/projected/be387a3c-02cc-43be-9508-b7406e6aa2b1-kube-api-access-7v2qf\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.297612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38140931-7de5-4bb9-baae-5c79e88653a6-metrics-client-ca\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-wtmp\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be387a3c-02cc-43be-9508-b7406e6aa2b1-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.297763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-root\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-textfile\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.297904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-sys\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.297904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.297904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-tls\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.298080 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.297905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnsp\" (UniqueName: \"kubernetes.io/projected/38140931-7de5-4bb9-baae-5c79e88653a6-kube-api-access-gdnsp\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.398885 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.398857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-wtmp\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.398892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be387a3c-02cc-43be-9508-b7406e6aa2b1-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.399027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.398909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-root\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.398925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-textfile\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.398991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-root\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399179 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-wtmp\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399179 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.399179 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-sys\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399179 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.399179 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-tls\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnsp\" (UniqueName: \"kubernetes.io/projected/38140931-7de5-4bb9-baae-5c79e88653a6-kube-api-access-gdnsp\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38140931-7de5-4bb9-baae-5c79e88653a6-sys\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-textfile\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:23.399244    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:23.399312    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-tls podName:be387a3c-02cc-43be-9508-b7406e6aa2b1 nodeName:}" failed. No retries permitted until 2026-09-18 13:16:23.89929546 +0000 UTC m=+101.268554834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-vrtn8" (UID: "be387a3c-02cc-43be-9508-b7406e6aa2b1") : secret "openshift-state-metrics-tls" not found
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:23.399319    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v2qf\" (UniqueName: \"kubernetes.io/projected/be387a3c-02cc-43be-9508-b7406e6aa2b1-kube-api-access-7v2qf\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.399431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38140931-7de5-4bb9-baae-5c79e88653a6-metrics-client-ca\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.399904 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:23.399588    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-tls podName:38140931-7de5-4bb9-baae-5c79e88653a6 nodeName:}" failed. No retries permitted until 2026-09-18 13:16:23.899571974 +0000 UTC m=+101.268831337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-tls") pod "node-exporter-wtgfr" (UID: "38140931-7de5-4bb9-baae-5c79e88653a6") : secret "node-exporter-tls" not found
Sep 18 13:16:23.399904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be387a3c-02cc-43be-9508-b7406e6aa2b1-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.400018 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.399995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38140931-7de5-4bb9-baae-5c79e88653a6-metrics-client-ca\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.400131 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.400109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.401382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.401366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.401481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.401463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.414955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.414932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v2qf\" (UniqueName: \"kubernetes.io/projected/be387a3c-02cc-43be-9508-b7406e6aa2b1-kube-api-access-7v2qf\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.417332 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.417314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnsp\" (UniqueName: \"kubernetes.io/projected/38140931-7de5-4bb9-baae-5c79e88653a6-kube-api-access-gdnsp\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.479901 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.479874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.605806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.605779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.622369 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.622338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kq7gj" event={"ID":"6f00e73f-7643-4db1-a96d-2bcf49f7237f","Type":"ContainerStarted","Data":"cf9292fd0994cd58b56b2f58fa5b225d6368f960b474bb7aa49286d12d3fbc2f"}
Sep 18 13:16:23.622642 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.622433    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kq7gj" event={"ID":"6f00e73f-7643-4db1-a96d-2bcf49f7237f","Type":"ContainerStarted","Data":"72dce302e965ae76177cb3d92012ebc802c4a343e8c9fc34852fce3668ba0ee1"}
Sep 18 13:16:23.622642 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.622535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:16:23.642000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.641956    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kq7gj" podStartSLOduration=65.766825897 podStartE2EDuration="1m7.641941369s" totalImagesPullingTime="1.875115472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:23.641716019 +0000 UTC m=+101.010975403" watchObservedRunningTime="2026-09-18 13:16:23.641941369 +0000 UTC m=+101.011200752"
Sep 18 13:16:23.712265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.712182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.808270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.808243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:23.903525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.903500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-tls\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.903663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.903612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:23.905726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.905704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38140931-7de5-4bb9-baae-5c79e88653a6-node-exporter-tls\") pod \"node-exporter-wtgfr\" (UID: \"38140931-7de5-4bb9-baae-5c79e88653a6\") " pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:23.905882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:23.905864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be387a3c-02cc-43be-9508-b7406e6aa2b1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vrtn8\" (UID: \"be387a3c-02cc-43be-9508-b7406e6aa2b1\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:24.096876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.096853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"
Sep 18 13:16:24.134682 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.134644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtgfr"
Sep 18 13:16:24.148644 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:24.148581    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38140931_7de5_4bb9_baae_5c79e88653a6.slice/crio-d6796a4188eaecb3aaebceeb61756dfbf19867ba50501780440d0f5e82030d9c WatchSource:0}: Error finding container d6796a4188eaecb3aaebceeb61756dfbf19867ba50501780440d0f5e82030d9c: Status 404 returned error can't find the container with id d6796a4188eaecb3aaebceeb61756dfbf19867ba50501780440d0f5e82030d9c
Sep 18 13:16:24.167047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.167022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:24.271621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.271595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:24.382686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.382626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8"]
Sep 18 13:16:24.386415 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:24.386392    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe387a3c_02cc_43be_9508_b7406e6aa2b1.slice/crio-d462226e0b6e8e6adf04332ab7a83d6ff6325c61f9e0d6571c244b84b3a0e65d WatchSource:0}: Error finding container d462226e0b6e8e6adf04332ab7a83d6ff6325c61f9e0d6571c244b84b3a0e65d: Status 404 returned error can't find the container with id d462226e0b6e8e6adf04332ab7a83d6ff6325c61f9e0d6571c244b84b3a0e65d
Sep 18 13:16:24.404495 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.404460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:24.597887 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.597856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:24.627570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.627539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtgfr" event={"ID":"38140931-7de5-4bb9-baae-5c79e88653a6","Type":"ContainerStarted","Data":"d6796a4188eaecb3aaebceeb61756dfbf19867ba50501780440d0f5e82030d9c"}
Sep 18 13:16:24.629706 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.629670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8" event={"ID":"be387a3c-02cc-43be-9508-b7406e6aa2b1","Type":"ContainerStarted","Data":"960cfddada245d6a636ecda80f42798253a870072b798e69541c4dec2a3289ed"}
Sep 18 13:16:24.629839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.629734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8" event={"ID":"be387a3c-02cc-43be-9508-b7406e6aa2b1","Type":"ContainerStarted","Data":"613f7a5dede6988d054c924a68899b84a0cd696b91c73401ed2cf40bf7b42555"}
Sep 18 13:16:24.629839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.629764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8" event={"ID":"be387a3c-02cc-43be-9508-b7406e6aa2b1","Type":"ContainerStarted","Data":"d462226e0b6e8e6adf04332ab7a83d6ff6325c61f9e0d6571c244b84b3a0e65d"}
Sep 18 13:16:24.697187 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:24.697130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:25.307496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.307470    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"]
Sep 18 13:16:25.311091 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.311074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.313906 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.313877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 13:16:25.314022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.313927    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 13:16:25.314022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.313986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 13:16:25.314022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.313986    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sz8cc\""
Sep 18 13:16:25.314254 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.313877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1iahtdc2i5voj\""
Sep 18 13:16:25.314254 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.314156    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 13:16:25.314375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.314254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 13:16:25.323958 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.323940    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"]
Sep 18 13:16:25.418436 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/830bc560-17ed-42fa-98d5-3d4447a360b9-metrics-client-ca\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418436 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-grpc-tls\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zktq\" (UniqueName: \"kubernetes.io/projected/830bc560-17ed-42fa-98d5-3d4447a360b9-kube-api-access-6zktq\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.418709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.418660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-tls\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.492811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.492778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cm6rb"
Sep 18 13:16:25.520016 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.519975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/830bc560-17ed-42fa-98d5-3d4447a360b9-metrics-client-ca\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-grpc-tls\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520461 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zktq\" (UniqueName: \"kubernetes.io/projected/830bc560-17ed-42fa-98d5-3d4447a360b9-kube-api-access-6zktq\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520461 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.520461 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.520304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-tls\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.521876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.521823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/830bc560-17ed-42fa-98d5-3d4447a360b9-metrics-client-ca\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.523542 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.523518    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.524174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.524146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.526057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.525484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-tls\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.526057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.525543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.526057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.525747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.526057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.526008    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/830bc560-17ed-42fa-98d5-3d4447a360b9-secret-grpc-tls\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.532833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.532815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zktq\" (UniqueName: \"kubernetes.io/projected/830bc560-17ed-42fa-98d5-3d4447a360b9-kube-api-access-6zktq\") pod \"thanos-querier-5b54476bf6-ncwrw\" (UID: \"830bc560-17ed-42fa-98d5-3d4447a360b9\") " pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.621774 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.621742    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:25.635065 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.635036    2564 generic.go:356] "Generic (PLEG): container finished" podID="38140931-7de5-4bb9-baae-5c79e88653a6" containerID="168337f9ccd2e284007e73e03bf1a56d7f4bfa010bf84a383cec2c7806f5ef94" exitCode=0
Sep 18 13:16:25.635466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.635080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtgfr" event={"ID":"38140931-7de5-4bb9-baae-5c79e88653a6","Type":"ContainerDied","Data":"168337f9ccd2e284007e73e03bf1a56d7f4bfa010bf84a383cec2c7806f5ef94"}
Sep 18 13:16:25.989280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:25.989252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"]
Sep 18 13:16:26.128596 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:26.128563    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830bc560_17ed_42fa_98d5_3d4447a360b9.slice/crio-e29fb85d1523257e589415ea684ce02bf0858fd557f1127448a9065f719fedf4 WatchSource:0}: Error finding container e29fb85d1523257e589415ea684ce02bf0858fd557f1127448a9065f719fedf4: Status 404 returned error can't find the container with id e29fb85d1523257e589415ea684ce02bf0858fd557f1127448a9065f719fedf4
Sep 18 13:16:26.172554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.172527    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:26.273166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.273140    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:26.484961 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.484916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:26.641624 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.641556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtgfr" event={"ID":"38140931-7de5-4bb9-baae-5c79e88653a6","Type":"ContainerStarted","Data":"2b96edf931591f29ceedd9b3a7afa61f790948dc2b3bc2a34c506e2b55167484"}
Sep 18 13:16:26.642033 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.641617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtgfr" event={"ID":"38140931-7de5-4bb9-baae-5c79e88653a6","Type":"ContainerStarted","Data":"2ba24ef613c64164f805108cbd62b407837438575341f5794370e2da06a4fb0e"}
Sep 18 13:16:26.643988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.643961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8" event={"ID":"be387a3c-02cc-43be-9508-b7406e6aa2b1","Type":"ContainerStarted","Data":"aad9398a07d15878247b26842276d937835a873b3c002b6c60af2a9997427f55"}
Sep 18 13:16:26.645230 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.645184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"e29fb85d1523257e589415ea684ce02bf0858fd557f1127448a9065f719fedf4"}
Sep 18 13:16:26.663076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.663031    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wtgfr" podStartSLOduration=2.663069827 podStartE2EDuration="3.66301994s" totalImagesPullingTime="935.492492ms" totalInitContainerRuntime="64.457621ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:26.662262864 +0000 UTC m=+104.031522249" watchObservedRunningTime="2026-09-18 13:16:26.66301994 +0000 UTC m=+104.032279321"
Sep 18 13:16:26.681636 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:26.681592    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vrtn8" podStartSLOduration=2.032463441 podStartE2EDuration="3.681579879s" totalImagesPullingTime="1.649116438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:26.680221456 +0000 UTC m=+104.049480839" watchObservedRunningTime="2026-09-18 13:16:26.681579879 +0000 UTC m=+104.050839260"
Sep 18 13:16:27.185410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:27.185372    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:27.287541 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:27.287505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:27.995183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:27.995153    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cfb9777-mpmfb"]
Sep 18 13:16:28.010024 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.009989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:28.013486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.013470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.025059 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.025038    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"]
Sep 18 13:16:28.046079 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.046058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfb9777-mpmfb"]
Sep 18 13:16:28.046165 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.046133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.053811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.053792    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"]
Sep 18 13:16:28.058560 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.058525    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 13:16:28.058675 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.058659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4cjpx\""
Sep 18 13:16:28.144245 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-config\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144329 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-trusted-ca-bundle\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm7l8\" (UniqueName: \"kubernetes.io/projected/29c13f40-6a90-4441-90c6-f818cad87524-kube-api-access-tm7l8\") pod \"monitoring-plugin-5984459ff8-ff96c\" (UID: \"29c13f40-6a90-4441-90c6-f818cad87524\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.144438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x22g\" (UniqueName: \"kubernetes.io/projected/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-kube-api-access-8x22g\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-serving-cert\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144513 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-oauth-config\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144513 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-oauth-serving-cert\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144587 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-service-ca\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.144587 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.144563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29c13f40-6a90-4441-90c6-f818cad87524-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ff96c\" (UID: \"29c13f40-6a90-4441-90c6-f818cad87524\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.244954 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.244935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-config\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245034 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.244960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-trusted-ca-bundle\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245034 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm7l8\" (UniqueName: \"kubernetes.io/projected/29c13f40-6a90-4441-90c6-f818cad87524-kube-api-access-tm7l8\") pod \"monitoring-plugin-5984459ff8-ff96c\" (UID: \"29c13f40-6a90-4441-90c6-f818cad87524\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.245034 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x22g\" (UniqueName: \"kubernetes.io/projected/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-kube-api-access-8x22g\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-serving-cert\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-oauth-config\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-oauth-serving-cert\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-service-ca\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.245468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29c13f40-6a90-4441-90c6-f818cad87524-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ff96c\" (UID: \"29c13f40-6a90-4441-90c6-f818cad87524\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.245468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:28.245726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-config\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.246012 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.245990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-trusted-ca-bundle\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.246158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.246079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-service-ca\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.246158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.246100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-oauth-serving-cert\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.247782 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.247750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-oauth-config\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.248172 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.248152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-serving-cert\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.248265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.248172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/29c13f40-6a90-4441-90c6-f818cad87524-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-ff96c\" (UID: \"29c13f40-6a90-4441-90c6-f818cad87524\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.255855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.255837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm7l8\" (UniqueName: \"kubernetes.io/projected/29c13f40-6a90-4441-90c6-f818cad87524-kube-api-access-tm7l8\") pod \"monitoring-plugin-5984459ff8-ff96c\" (UID: \"29c13f40-6a90-4441-90c6-f818cad87524\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.256848 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.256823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x22g\" (UniqueName: \"kubernetes.io/projected/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-kube-api-access-8x22g\") pod \"console-7cfb9777-mpmfb\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") " pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.322087 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.322063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:28.348236 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.348215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:28.354089 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.354075    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:28.654936 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.654824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"833273686fd6436b7c6f55e0d77b8f16212527b89bed80b1d38689691616db5c"}
Sep 18 13:16:28.654936 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.654903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"17d8f2b0ee8ec0e363ad6d2ae6292e20a053d75d5ebf12ede778d77dbb2cf478"}
Sep 18 13:16:28.665444 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.665412    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"]
Sep 18 13:16:28.668331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:28.668301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfb9777-mpmfb"]
Sep 18 13:16:28.668789 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:28.668764    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c13f40_6a90_4441_90c6_f818cad87524.slice/crio-513e7b88f296051f4257c8d15a669263db18d6316bb046649dda55b533f9a367 WatchSource:0}: Error finding container 513e7b88f296051f4257c8d15a669263db18d6316bb046649dda55b533f9a367: Status 404 returned error can't find the container with id 513e7b88f296051f4257c8d15a669263db18d6316bb046649dda55b533f9a367
Sep 18 13:16:28.672757 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:28.672725    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dd7651_4671_4d1c_84ad_cfaa3a23fdef.slice/crio-0b81b9bec541282d3e0a0d872e82a83e0e84f36f4455e290d12dfd13f76ae0f5 WatchSource:0}: Error finding container 0b81b9bec541282d3e0a0d872e82a83e0e84f36f4455e290d12dfd13f76ae0f5: Status 404 returned error can't find the container with id 0b81b9bec541282d3e0a0d872e82a83e0e84f36f4455e290d12dfd13f76ae0f5
Sep 18 13:16:29.502314 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:29.502278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:29.663067 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:29.663020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c" event={"ID":"29c13f40-6a90-4441-90c6-f818cad87524","Type":"ContainerStarted","Data":"513e7b88f296051f4257c8d15a669263db18d6316bb046649dda55b533f9a367"}
Sep 18 13:16:29.665016 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:29.664988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb9777-mpmfb" event={"ID":"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef","Type":"ContainerStarted","Data":"4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a"}
Sep 18 13:16:29.665140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:29.665041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb9777-mpmfb" event={"ID":"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef","Type":"ContainerStarted","Data":"0b81b9bec541282d3e0a0d872e82a83e0e84f36f4455e290d12dfd13f76ae0f5"}
Sep 18 13:16:29.667508 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:29.667479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"8e6da0874bdd892c2e126cfa04bde9c961e038af69c5b9333c359647f95dddfe"}
Sep 18 13:16:29.690784 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:29.690738    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cfb9777-mpmfb" podStartSLOduration=2.690724258 podStartE2EDuration="2.690724258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:29.689656314 +0000 UTC m=+107.058915698" watchObservedRunningTime="2026-09-18 13:16:29.690724258 +0000 UTC m=+107.059983630"
Sep 18 13:16:30.362965 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.362889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:30.463321 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.463284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:30.672684 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.672614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c" event={"ID":"29c13f40-6a90-4441-90c6-f818cad87524","Type":"ContainerStarted","Data":"23eee2c1b6813450542f76d27219aa0b22b75518d2ba5ba3420e4cc86d4e3b9e"}
Sep 18 13:16:30.673055 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.672700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:30.675889 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.675865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"f30dc22e8c655ee9cacb2abce104d84920139745368140ee12f77a4ecf947117"}
Sep 18 13:16:30.675991 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.675925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"92e63e0e21327113bc34fd733af034d1bfb69b3b590ff93060da81e098ddf6e4"}
Sep 18 13:16:30.675991 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.675962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" event={"ID":"830bc560-17ed-42fa-98d5-3d4447a360b9","Type":"ContainerStarted","Data":"95d3375535358dfd7c8a3f8cf78d68e4e9b94bc5946d957eb352108cf9d6a0fd"}
Sep 18 13:16:30.678094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.678073    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c"
Sep 18 13:16:30.690927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.690886    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-ff96c" podStartSLOduration=2.328282754 podStartE2EDuration="3.690873095s" totalImagesPullingTime="1.362590341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:30.689897511 +0000 UTC m=+108.059156894" watchObservedRunningTime="2026-09-18 13:16:30.690873095 +0000 UTC m=+108.060132476"
Sep 18 13:16:30.726848 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:30.726811    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw" podStartSLOduration=2.221203747 podStartE2EDuration="5.72679613s" totalImagesPullingTime="3.505592383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:16:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:30.724696813 +0000 UTC m=+108.093956196" watchObservedRunningTime="2026-09-18 13:16:30.72679613 +0000 UTC m=+108.096055514"
Sep 18 13:16:31.680486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:31.680444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:33.632066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:33.632041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kq7gj"
Sep 18 13:16:34.337554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:34.337524    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df49b7874-mwchc"]
Sep 18 13:16:34.434166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:34.434132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:34.534531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:34.534500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:34.634590 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:34.634531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:37.193937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:37.193903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:37.267505 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:37.267477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:37.689938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:37.689912    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b54476bf6-ncwrw"
Sep 18 13:16:38.322417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:38.322384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:38.322855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:38.322447    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:38.327621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:38.327595    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:38.709404 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:38.709325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:16:38.757269 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:38.757237    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-767f4c4885-9vtlc"]
Sep 18 13:16:42.759325 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:42.759294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:42.862928 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:42.862894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:44.342903 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:44.342872    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:44.820639 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:44.820605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:45.756046 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:45.756011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:45.810740 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:45.810712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:48.110835 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:48.110796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:48.217021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:48.216993    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:53.023083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:53.023048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:16:53.025333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:53.025301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a09ae84-dbc8-4957-b9b6-d8eaf219489f-metrics-certs\") pod \"network-metrics-daemon-brm8b\" (UID: \"3a09ae84-dbc8-4957-b9b6-d8eaf219489f\") " pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:16:53.035986 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:53.035964    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4rmbt\""
Sep 18 13:16:53.043997 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:53.043981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-brm8b"
Sep 18 13:16:53.330478 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:53.330403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-brm8b"]
Sep 18 13:16:53.332689 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:16:53.332667    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a09ae84_dbc8_4957_b9b6_d8eaf219489f.slice/crio-ceb82ef465bc538b7b1761b019a737d277e0e970ea6072ba9e9ee13ba8acecb9 WatchSource:0}: Error finding container ceb82ef465bc538b7b1761b019a737d277e0e970ea6072ba9e9ee13ba8acecb9: Status 404 returned error can't find the container with id ceb82ef465bc538b7b1761b019a737d277e0e970ea6072ba9e9ee13ba8acecb9
Sep 18 13:16:53.760877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:53.760848    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brm8b" event={"ID":"3a09ae84-dbc8-4957-b9b6-d8eaf219489f","Type":"ContainerStarted","Data":"ceb82ef465bc538b7b1761b019a737d277e0e970ea6072ba9e9ee13ba8acecb9"}
Sep 18 13:16:54.766816 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:54.766786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brm8b" event={"ID":"3a09ae84-dbc8-4957-b9b6-d8eaf219489f","Type":"ContainerStarted","Data":"3633028489c074607ffdd02281d8970f3fa421520d5d384fccaf0028ad813f7d"}
Sep 18 13:16:54.767121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:54.766833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-brm8b" event={"ID":"3a09ae84-dbc8-4957-b9b6-d8eaf219489f","Type":"ContainerStarted","Data":"b396757e514f0041f158571c4d51e7c2d8c63845f0b079a9b2bd97ca9a9fd7bc"}
Sep 18 13:16:54.790819 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:54.790773    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-brm8b" podStartSLOduration=130.880556375 podStartE2EDuration="2m11.79075774s" totalImagesPullingTime="910.201365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:16:54.789130629 +0000 UTC m=+132.158390011" watchObservedRunningTime="2026-09-18 13:16:54.79075774 +0000 UTC m=+132.160017121"
Sep 18 13:16:54.929335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:54.929314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:55.029612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:55.029555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:16:56.775588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:56.775559    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cef1c8e-6903-45bb-b619-b5e9f81df344" containerID="a80a505c32e646c69281bd35eb1f33c52b155ccb990fcb199204f14af3eb6999" exitCode=0
Sep 18 13:16:56.775865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:56.775629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9" event={"ID":"9cef1c8e-6903-45bb-b619-b5e9f81df344","Type":"ContainerDied","Data":"a80a505c32e646c69281bd35eb1f33c52b155ccb990fcb199204f14af3eb6999"}
Sep 18 13:16:56.775981 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:56.775963    2564 scope.go:117] "RemoveContainer" containerID="a80a505c32e646c69281bd35eb1f33c52b155ccb990fcb199204f14af3eb6999"
Sep 18 13:16:57.781027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:57.780997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dfqt9" event={"ID":"9cef1c8e-6903-45bb-b619-b5e9f81df344","Type":"ContainerStarted","Data":"5759daa367fb7bc028964d99d6cf5701d22b68c94eb2746de3e526a053a12c9c"}
Sep 18 13:16:57.932137 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:57.932105    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7d894bd-qg4wn_60f23438-f412-408c-9cc5-fcdc68f56508/router/0.log"
Sep 18 13:16:57.953416 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:57.953393    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4smz_63858915-ce5e-476e-9d25-98a599268e93/serve-healthcheck-canary/0.log"
Sep 18 13:16:59.355780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.355745    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6df49b7874-mwchc" podUID="bfb9ad4c-528d-4025-b717-868e02683c38" containerName="registry" containerID="cri-o://ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3" gracePeriod=30
Sep 18 13:16:59.587183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.587163    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:59.669830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669778    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-trusted-ca\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.669830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669811    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x9cj\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-kube-api-access-4x9cj\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.669952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669835    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.669952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-image-registry-private-configuration\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.669952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-installation-pull-secrets\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.669952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669944    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfb9ad4c-528d-4025-b717-868e02683c38-ca-trust-extracted\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.670140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.669973    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-bound-sa-token\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.670274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.670247    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:16:59.672397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.672236    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:16:59.672397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.672344    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-kube-api-access-4x9cj" (OuterVolumeSpecName: "kube-api-access-4x9cj") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "kube-api-access-4x9cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:16:59.672397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.672367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:16:59.672397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.672396    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:16:59.672606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.672479    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:16:59.678748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.678724    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb9ad4c-528d-4025-b717-868e02683c38-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:16:59.770657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770637    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-registry-certificates\") pod \"bfb9ad4c-528d-4025-b717-868e02683c38\" (UID: \"bfb9ad4c-528d-4025-b717-868e02683c38\") "
Sep 18 13:16:59.770800 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770788    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfb9ad4c-528d-4025-b717-868e02683c38-ca-trust-extracted\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.770836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770802    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-bound-sa-token\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.770836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770811    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-trusted-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.770836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770819    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x9cj\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-kube-api-access-4x9cj\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.770836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770827    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfb9ad4c-528d-4025-b717-868e02683c38-registry-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.770836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770836    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-image-registry-private-configuration\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.771018 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770845    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfb9ad4c-528d-4025-b717-868e02683c38-installation-pull-secrets\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:16:59.771018 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.770910    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bfb9ad4c-528d-4025-b717-868e02683c38" (UID: "bfb9ad4c-528d-4025-b717-868e02683c38"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:16:59.790279 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.790253    2564 generic.go:356] "Generic (PLEG): container finished" podID="bfb9ad4c-528d-4025-b717-868e02683c38" containerID="ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3" exitCode=0
Sep 18 13:16:59.790380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.790300    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df49b7874-mwchc"
Sep 18 13:16:59.790438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.790302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df49b7874-mwchc" event={"ID":"bfb9ad4c-528d-4025-b717-868e02683c38","Type":"ContainerDied","Data":"ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3"}
Sep 18 13:16:59.790438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.790425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df49b7874-mwchc" event={"ID":"bfb9ad4c-528d-4025-b717-868e02683c38","Type":"ContainerDied","Data":"b88e58f344e2f52fec212a9ed3909263ef5669f3fbd822eb33bb00cddcb068e9"}
Sep 18 13:16:59.790533 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.790460    2564 scope.go:117] "RemoveContainer" containerID="ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3"
Sep 18 13:16:59.798471 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.798451    2564 scope.go:117] "RemoveContainer" containerID="ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3"
Sep 18 13:16:59.798767 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:16:59.798743    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3\": container with ID starting with ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3 not found: ID does not exist" containerID="ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3"
Sep 18 13:16:59.798821 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.798778    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3"} err="failed to get container status \"ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3\": rpc error: code = NotFound desc = could not find container \"ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3\": container with ID starting with ecc159e4aaab66514a68feb9c2b16f8acf070e5a7cd46790cd60f07f1a40eeb3 not found: ID does not exist"
Sep 18 13:16:59.815265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.815245    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df49b7874-mwchc"]
Sep 18 13:16:59.818846 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.818829    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6df49b7874-mwchc"]
Sep 18 13:16:59.871205 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:16:59.871169    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfb9ad4c-528d-4025-b717-868e02683c38-registry-certificates\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:01.213401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:01.213372    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfb9ad4c-528d-4025-b717-868e02683c38" path="/var/lib/kubelet/pods/bfb9ad4c-528d-4025-b717-868e02683c38/volumes"
Sep 18 13:17:03.087327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:03.087295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:03.175280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:03.175252    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:03.776605 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:03.776573    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-767f4c4885-9vtlc" podUID="b72b1af5-2a83-47af-ba42-380f4cb199a1" containerName="console" containerID="cri-o://7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d" gracePeriod=15
Sep 18 13:17:04.019443 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.019418    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:17:04.099173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8kcm\" (UniqueName: \"kubernetes.io/projected/b72b1af5-2a83-47af-ba42-380f4cb199a1-kube-api-access-g8kcm\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099143    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-service-ca\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099165    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-oauth-serving-cert\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099226    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-config\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-oauth-config\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099288    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-serving-cert\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099630    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:17:04.099678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099626    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:17:04.099866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099676    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-config" (OuterVolumeSpecName: "console-config") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:17:04.099866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099727    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-trusted-ca-bundle\") pod \"b72b1af5-2a83-47af-ba42-380f4cb199a1\" (UID: \"b72b1af5-2a83-47af-ba42-380f4cb199a1\") "
Sep 18 13:17:04.099983 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099961    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-oauth-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.100039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099982    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.100039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.099996    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.100182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.100162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:17:04.101480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.101452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72b1af5-2a83-47af-ba42-380f4cb199a1-kube-api-access-g8kcm" (OuterVolumeSpecName: "kube-api-access-g8kcm") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "kube-api-access-g8kcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:17:04.101569 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.101536    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:17:04.101843 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.101815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b72b1af5-2a83-47af-ba42-380f4cb199a1" (UID: "b72b1af5-2a83-47af-ba42-380f4cb199a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:17:04.200452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.200430    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72b1af5-2a83-47af-ba42-380f4cb199a1-trusted-ca-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.200452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.200451    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8kcm\" (UniqueName: \"kubernetes.io/projected/b72b1af5-2a83-47af-ba42-380f4cb199a1-kube-api-access-g8kcm\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.200565 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.200460    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-oauth-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.200565 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.200469    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72b1af5-2a83-47af-ba42-380f4cb199a1-console-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:17:04.814935 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.814899    2564 generic.go:356] "Generic (PLEG): container finished" podID="b72b1af5-2a83-47af-ba42-380f4cb199a1" containerID="7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d" exitCode=0
Sep 18 13:17:04.815093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.814955    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767f4c4885-9vtlc"
Sep 18 13:17:04.815093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.814962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767f4c4885-9vtlc" event={"ID":"b72b1af5-2a83-47af-ba42-380f4cb199a1","Type":"ContainerDied","Data":"7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d"}
Sep 18 13:17:04.815093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.815044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767f4c4885-9vtlc" event={"ID":"b72b1af5-2a83-47af-ba42-380f4cb199a1","Type":"ContainerDied","Data":"177bb05387ab567db0552b7e65a41460603f74a2fb7d302d6a17ebc88c9e181b"}
Sep 18 13:17:04.815093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.815067    2564 scope.go:117] "RemoveContainer" containerID="7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d"
Sep 18 13:17:04.823015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.822995    2564 scope.go:117] "RemoveContainer" containerID="7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d"
Sep 18 13:17:04.823288 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:17:04.823269    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d\": container with ID starting with 7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d not found: ID does not exist" containerID="7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d"
Sep 18 13:17:04.823354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.823296    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d"} err="failed to get container status \"7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d\": rpc error: code = NotFound desc = could not find container \"7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d\": container with ID starting with 7472016421ffcca5d0b4df2b7eb5d58c48ed887aec2e5f833081f9a7a3e6525d not found: ID does not exist"
Sep 18 13:17:04.838499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.838477    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-767f4c4885-9vtlc"]
Sep 18 13:17:04.847524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:04.847505    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-767f4c4885-9vtlc"]
Sep 18 13:17:05.212454 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:05.212408    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b72b1af5-2a83-47af-ba42-380f4cb199a1" path="/var/lib/kubelet/pods/b72b1af5-2a83-47af-ba42-380f4cb199a1/volumes"
Sep 18 13:17:06.341059 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:06.341036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:09.958433 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:09.958379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:10.128881 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:10.128827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:10.238036 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:10.238003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:42.594431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:42.594344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:42.870726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:42.870635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:51.172303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172269    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f97f8f85b-ptfj2"]
Sep 18 13:17:51.172762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172572    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfb9ad4c-528d-4025-b717-868e02683c38" containerName="registry"
Sep 18 13:17:51.172762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172593    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb9ad4c-528d-4025-b717-868e02683c38" containerName="registry"
Sep 18 13:17:51.172762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172602    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72b1af5-2a83-47af-ba42-380f4cb199a1" containerName="console"
Sep 18 13:17:51.172762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172609    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72b1af5-2a83-47af-ba42-380f4cb199a1" containerName="console"
Sep 18 13:17:51.172762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172657    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72b1af5-2a83-47af-ba42-380f4cb199a1" containerName="console"
Sep 18 13:17:51.172762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.172669    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfb9ad4c-528d-4025-b717-868e02683c38" containerName="registry"
Sep 18 13:17:51.176886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.176868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.195262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.195238    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f97f8f85b-ptfj2"]
Sep 18 13:17:51.233328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-oauth-serving-cert\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.233439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-trusted-ca-bundle\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.233439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84msx\" (UniqueName: \"kubernetes.io/projected/2027e15c-586b-4b54-ace2-8c7e57b554ba-kube-api-access-84msx\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.233439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-oauth-config\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.233538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-service-ca\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.233538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-serving-cert\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.233538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.233498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-config\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.325450 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.325416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:51.334527 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84msx\" (UniqueName: \"kubernetes.io/projected/2027e15c-586b-4b54-ace2-8c7e57b554ba-kube-api-access-84msx\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.334608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-oauth-config\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.334608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-service-ca\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.334608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-serving-cert\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.334608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-config\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.334824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-oauth-serving-cert\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.334824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.334683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-trusted-ca-bundle\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.335387 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.335355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-service-ca\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.335470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.335355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-config\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.335470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.335363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-oauth-serving-cert\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.335627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.335606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-trusted-ca-bundle\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.336896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.336871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-oauth-config\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.337211 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.337168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-serving-cert\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.344880 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.344862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84msx\" (UniqueName: \"kubernetes.io/projected/2027e15c-586b-4b54-ace2-8c7e57b554ba-kube-api-access-84msx\") pod \"console-f97f8f85b-ptfj2\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") " pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.404602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.404570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:17:51.485316 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.485291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:17:51.758417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.758347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f97f8f85b-ptfj2"]
Sep 18 13:17:51.761153 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:17:51.761128    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2027e15c_586b_4b54_ace2_8c7e57b554ba.slice/crio-b4422ce1dc208778566637d9f2aeb662130454532ac5e41cb5cad65d4cd26825 WatchSource:0}: Error finding container b4422ce1dc208778566637d9f2aeb662130454532ac5e41cb5cad65d4cd26825: Status 404 returned error can't find the container with id b4422ce1dc208778566637d9f2aeb662130454532ac5e41cb5cad65d4cd26825
Sep 18 13:17:51.994511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.994475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f97f8f85b-ptfj2" event={"ID":"2027e15c-586b-4b54-ace2-8c7e57b554ba","Type":"ContainerStarted","Data":"0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1"}
Sep 18 13:17:51.994680 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:51.994526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f97f8f85b-ptfj2" event={"ID":"2027e15c-586b-4b54-ace2-8c7e57b554ba","Type":"ContainerStarted","Data":"b4422ce1dc208778566637d9f2aeb662130454532ac5e41cb5cad65d4cd26825"}
Sep 18 13:17:52.013935 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:17:52.013832    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f97f8f85b-ptfj2" podStartSLOduration=1.013811144 podStartE2EDuration="1.013811144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:17:52.012942655 +0000 UTC m=+189.382202036" watchObservedRunningTime="2026-09-18 13:17:52.013811144 +0000 UTC m=+189.383070527"
Sep 18 13:18:01.486440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:01.486404    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:18:01.486986 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:01.486466    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:18:01.490953 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:01.490931    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:18:02.034206 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:02.034174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:18:02.093720 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:02.093692    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfb9777-mpmfb"]
Sep 18 13:18:02.262815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:02.262783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:02.374568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:02.374496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:27.115022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.114965    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cfb9777-mpmfb" podUID="a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" containerName="console" containerID="cri-o://4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a" gracePeriod=15
Sep 18 13:18:27.348558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.348533    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:18:27.477212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-service-ca\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x22g\" (UniqueName: \"kubernetes.io/projected/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-kube-api-access-8x22g\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477405 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-serving-cert\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477405 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477249    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-oauth-config\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477405 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477371    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-trusted-ca-bundle\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477559 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-config\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477559 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-oauth-serving-cert\") pod \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\" (UID: \"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef\") "
Sep 18 13:18:27.477686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477654    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:18:27.477784 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477757    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:18:27.477848 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-config" (OuterVolumeSpecName: "console-config") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:18:27.477997 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.477973    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:18:27.479327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.479303    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-kube-api-access-8x22g" (OuterVolumeSpecName: "kube-api-access-8x22g") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "kube-api-access-8x22g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:18:27.479417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.479321    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:18:27.479417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.479339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" (UID: "a1dd7651-4671-4d1c-84ad-cfaa3a23fdef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:18:27.578121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578088    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x22g\" (UniqueName: \"kubernetes.io/projected/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-kube-api-access-8x22g\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:27.578121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578118    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:27.578121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578127    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-oauth-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:27.578305 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578136    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-trusted-ca-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:27.578305 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578145    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-console-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:27.578305 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578153    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-oauth-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:27.578305 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:27.578161    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:18:28.045930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.045905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:28.109385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.109362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:28.123519 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.123496    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" containerID="4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a" exitCode=0
Sep 18 13:18:28.123791 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.123549    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb9777-mpmfb"
Sep 18 13:18:28.123791 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.123555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb9777-mpmfb" event={"ID":"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef","Type":"ContainerDied","Data":"4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a"}
Sep 18 13:18:28.123791 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.123623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb9777-mpmfb" event={"ID":"a1dd7651-4671-4d1c-84ad-cfaa3a23fdef","Type":"ContainerDied","Data":"0b81b9bec541282d3e0a0d872e82a83e0e84f36f4455e290d12dfd13f76ae0f5"}
Sep 18 13:18:28.123791 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.123645    2564 scope.go:117] "RemoveContainer" containerID="4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a"
Sep 18 13:18:28.131581 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.131471    2564 scope.go:117] "RemoveContainer" containerID="4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a"
Sep 18 13:18:28.131761 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:18:28.131741    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a\": container with ID starting with 4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a not found: ID does not exist" containerID="4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a"
Sep 18 13:18:28.131813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.131766    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a"} err="failed to get container status \"4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a\": rpc error: code = NotFound desc = could not find container \"4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a\": container with ID starting with 4fa05527a257da652d75e8efbdbc388166ef41f5c38dac51e52976eedb7d5b6a not found: ID does not exist"
Sep 18 13:18:28.144674 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.144650    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfb9777-mpmfb"]
Sep 18 13:18:28.150747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:28.150726    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cfb9777-mpmfb"]
Sep 18 13:18:29.213154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:29.213131    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" path="/var/lib/kubelet/pods/a1dd7651-4671-4d1c-84ad-cfaa3a23fdef/volumes"
Sep 18 13:18:58.071992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:58.071953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:58.152080 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:58.152045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:59.307241 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.307210    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5556f5bf6f-dvvxj"]
Sep 18 13:18:59.307570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.307462    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" containerName="console"
Sep 18 13:18:59.307570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.307472    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" containerName="console"
Sep 18 13:18:59.307570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.307531    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1dd7651-4671-4d1c-84ad-cfaa3a23fdef" containerName="console"
Sep 18 13:18:59.311483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.311468    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.330213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.330181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5556f5bf6f-dvvxj"]
Sep 18 13:18:59.381072 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.381047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:59.391288 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-console-config\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.391386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-trusted-ca-bundle\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.391386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-serving-cert\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.391468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-oauth-config\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.391468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-service-ca\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.391530 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt4q8\" (UniqueName: \"kubernetes.io/projected/771b1d5a-29eb-4de1-826b-133925853ed3-kube-api-access-xt4q8\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.391530 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.391491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-oauth-serving-cert\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.457836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.457810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:18:59.491758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-oauth-config\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.491836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-service-ca\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.491836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt4q8\" (UniqueName: \"kubernetes.io/projected/771b1d5a-29eb-4de1-826b-133925853ed3-kube-api-access-xt4q8\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.491836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-oauth-serving-cert\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.491836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-console-config\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.492035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-trusted-ca-bundle\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.492035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.491908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-serving-cert\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.492585 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.492563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-service-ca\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.492707 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.492641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-console-config\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.492707 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.492663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-oauth-serving-cert\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.492878 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.492859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-trusted-ca-bundle\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.494152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.494135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-oauth-config\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.494349 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.494331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-serving-cert\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.501911 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.501891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt4q8\" (UniqueName: \"kubernetes.io/projected/771b1d5a-29eb-4de1-826b-133925853ed3-kube-api-access-xt4q8\") pod \"console-5556f5bf6f-dvvxj\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") " pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.619682 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.619634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:18:59.906331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:18:59.906249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5556f5bf6f-dvvxj"]
Sep 18 13:18:59.910102 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:18:59.910076    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771b1d5a_29eb_4de1_826b_133925853ed3.slice/crio-8f28df77595cee7505b8481dc83f10ec0dca0071effb49cacd29281b7515cc85 WatchSource:0}: Error finding container 8f28df77595cee7505b8481dc83f10ec0dca0071effb49cacd29281b7515cc85: Status 404 returned error can't find the container with id 8f28df77595cee7505b8481dc83f10ec0dca0071effb49cacd29281b7515cc85
Sep 18 13:19:00.236364 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:00.236339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556f5bf6f-dvvxj" event={"ID":"771b1d5a-29eb-4de1-826b-133925853ed3","Type":"ContainerStarted","Data":"2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887"}
Sep 18 13:19:00.236512 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:00.236377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556f5bf6f-dvvxj" event={"ID":"771b1d5a-29eb-4de1-826b-133925853ed3","Type":"ContainerStarted","Data":"8f28df77595cee7505b8481dc83f10ec0dca0071effb49cacd29281b7515cc85"}
Sep 18 13:19:00.256183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:00.256141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5556f5bf6f-dvvxj" podStartSLOduration=1.256126354 podStartE2EDuration="1.256126354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:18:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:19:00.254514445 +0000 UTC m=+257.623773828" watchObservedRunningTime="2026-09-18 13:19:00.256126354 +0000 UTC m=+257.625385797"
Sep 18 13:19:09.287549 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:09.287480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:09.620421 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:09.620351    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:19:09.620421 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:09.620403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:19:09.625098 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:09.625077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:19:09.878687 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:09.878619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:09.978164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:09.978137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:10.274054 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:10.274032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:19:10.325790 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:10.325767    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f97f8f85b-ptfj2"]
Sep 18 13:19:10.477121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:10.477089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:10.583888 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:10.583818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:10.641553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:10.641524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:16.623660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:16.623626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:18.109231 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:18.109168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:18.225585 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:18.225553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:18.515616 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:18.515588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:35.346231 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.346180    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f97f8f85b-ptfj2" podUID="2027e15c-586b-4b54-ace2-8c7e57b554ba" containerName="console" containerID="cri-o://0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1" gracePeriod=15
Sep 18 13:19:35.576879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.576857    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:19:35.635158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84msx\" (UniqueName: \"kubernetes.io/projected/2027e15c-586b-4b54-ace2-8c7e57b554ba-kube-api-access-84msx\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635137    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-trusted-ca-bundle\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635173    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-serving-cert\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635221    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-oauth-serving-cert\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635254    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-service-ca\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-oauth-config\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-config\") pod \"2027e15c-586b-4b54-ace2-8c7e57b554ba\" (UID: \"2027e15c-586b-4b54-ace2-8c7e57b554ba\") "
Sep 18 13:19:35.635724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635599    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:19:35.635839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635689    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:19:35.635839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635769    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:19:35.635839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.635818    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-config" (OuterVolumeSpecName: "console-config") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:19:35.637156 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.637131    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2027e15c-586b-4b54-ace2-8c7e57b554ba-kube-api-access-84msx" (OuterVolumeSpecName: "kube-api-access-84msx") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "kube-api-access-84msx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:19:35.637282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.637176    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:19:35.637327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.637311    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2027e15c-586b-4b54-ace2-8c7e57b554ba" (UID: "2027e15c-586b-4b54-ace2-8c7e57b554ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:19:35.736382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736363    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:35.736382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736380    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84msx\" (UniqueName: \"kubernetes.io/projected/2027e15c-586b-4b54-ace2-8c7e57b554ba-kube-api-access-84msx\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:35.736491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736389    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-trusted-ca-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:35.736491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736397    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:35.736491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736405    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-oauth-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:35.736491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736413    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2027e15c-586b-4b54-ace2-8c7e57b554ba-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:35.736491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:35.736420    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2027e15c-586b-4b54-ace2-8c7e57b554ba-console-oauth-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:19:36.358753 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.358727    2564 generic.go:356] "Generic (PLEG): container finished" podID="2027e15c-586b-4b54-ace2-8c7e57b554ba" containerID="0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1" exitCode=0
Sep 18 13:19:36.359111 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.358769    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f97f8f85b-ptfj2"
Sep 18 13:19:36.359111 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.358779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f97f8f85b-ptfj2" event={"ID":"2027e15c-586b-4b54-ace2-8c7e57b554ba","Type":"ContainerDied","Data":"0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1"}
Sep 18 13:19:36.359111 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.358810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f97f8f85b-ptfj2" event={"ID":"2027e15c-586b-4b54-ace2-8c7e57b554ba","Type":"ContainerDied","Data":"b4422ce1dc208778566637d9f2aeb662130454532ac5e41cb5cad65d4cd26825"}
Sep 18 13:19:36.359111 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.358830    2564 scope.go:117] "RemoveContainer" containerID="0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1"
Sep 18 13:19:36.366811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.366795    2564 scope.go:117] "RemoveContainer" containerID="0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1"
Sep 18 13:19:36.367076 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:19:36.367053    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1\": container with ID starting with 0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1 not found: ID does not exist" containerID="0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1"
Sep 18 13:19:36.367156 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.367081    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1"} err="failed to get container status \"0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1\": rpc error: code = NotFound desc = could not find container \"0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1\": container with ID starting with 0d3c65627c5eb62d2c3501dc37a5f60b3de7fe0aef8dece49f4c4824789b64a1 not found: ID does not exist"
Sep 18 13:19:36.382103 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.382040    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f97f8f85b-ptfj2"]
Sep 18 13:19:36.383184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:36.383167    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f97f8f85b-ptfj2"]
Sep 18 13:19:37.213980 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:37.213951    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2027e15c-586b-4b54-ace2-8c7e57b554ba" path="/var/lib/kubelet/pods/2027e15c-586b-4b54-ace2-8c7e57b554ba/volumes"
Sep 18 13:19:43.045860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:43.045829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:19:43.050354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:43.050333    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 13:19:43.054465 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:43.054430    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:19:44.095409 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.095384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:44.201589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.201566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:19:44.944090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.944065    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"]
Sep 18 13:19:44.944347 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.944334    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2027e15c-586b-4b54-ace2-8c7e57b554ba" containerName="console"
Sep 18 13:19:44.944402 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.944348    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2027e15c-586b-4b54-ace2-8c7e57b554ba" containerName="console"
Sep 18 13:19:44.944444 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.944406    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2027e15c-586b-4b54-ace2-8c7e57b554ba" containerName="console"
Sep 18 13:19:44.947249 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.947235    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:44.949831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.949814    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 13:19:44.949943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.949814    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 13:19:44.950816 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.950797    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tkn46\""
Sep 18 13:19:44.962060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.962017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"]
Sep 18 13:19:44.997317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.997292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:44.997415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.997331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:44.997415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:44.997374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxll\" (UniqueName: \"kubernetes.io/projected/349bbd7d-5517-4324-b96e-f3122f3f7655-kube-api-access-gwxll\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.098113 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.098085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.098476 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.098145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxll\" (UniqueName: \"kubernetes.io/projected/349bbd7d-5517-4324-b96e-f3122f3f7655-kube-api-access-gwxll\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.098476 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.098215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.098476 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.098438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.098622 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.098536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.106282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.106264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxll\" (UniqueName: \"kubernetes.io/projected/349bbd7d-5517-4324-b96e-f3122f3f7655-kube-api-access-gwxll\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.262239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.262222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:19:45.533159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.533090    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"]
Sep 18 13:19:45.535800 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:19:45.535776    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349bbd7d_5517_4324_b96e_f3122f3f7655.slice/crio-2320da3e958df2d5252eb07d633b74bd7dc574efbc1ff87188281bbe139316f9 WatchSource:0}: Error finding container 2320da3e958df2d5252eb07d633b74bd7dc574efbc1ff87188281bbe139316f9: Status 404 returned error can't find the container with id 2320da3e958df2d5252eb07d633b74bd7dc574efbc1ff87188281bbe139316f9
Sep 18 13:19:45.537618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:45.537588    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:19:46.397146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:46.397122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf" event={"ID":"349bbd7d-5517-4324-b96e-f3122f3f7655","Type":"ContainerStarted","Data":"2320da3e958df2d5252eb07d633b74bd7dc574efbc1ff87188281bbe139316f9"}
Sep 18 13:19:53.425628 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:53.425594    2564 generic.go:356] "Generic (PLEG): container finished" podID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerID="08d693bb61dbf948877e2a0c4c879bffc1720bfc8d5f641287e66a83b6689223" exitCode=0
Sep 18 13:19:53.426181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:53.425636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf" event={"ID":"349bbd7d-5517-4324-b96e-f3122f3f7655","Type":"ContainerDied","Data":"08d693bb61dbf948877e2a0c4c879bffc1720bfc8d5f641287e66a83b6689223"}
Sep 18 13:19:56.439739 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:56.439713    2564 generic.go:356] "Generic (PLEG): container finished" podID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerID="bbf1e2b0a46bd5256e8a2635699ae4fc0426e603be1ab77d6ddd92e51acb2c32" exitCode=0
Sep 18 13:19:56.440039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:19:56.439801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf" event={"ID":"349bbd7d-5517-4324-b96e-f3122f3f7655","Type":"ContainerDied","Data":"bbf1e2b0a46bd5256e8a2635699ae4fc0426e603be1ab77d6ddd92e51acb2c32"}
Sep 18 13:20:03.470534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:03.470478    2564 generic.go:356] "Generic (PLEG): container finished" podID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerID="ead6ddc932851c8cf88044c588fc193baa61f1ad6bda157f24c9f8c92bebad07" exitCode=0
Sep 18 13:20:03.470814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:03.470549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf" event={"ID":"349bbd7d-5517-4324-b96e-f3122f3f7655","Type":"ContainerDied","Data":"ead6ddc932851c8cf88044c588fc193baa61f1ad6bda157f24c9f8c92bebad07"}
Sep 18 13:20:04.590381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.590358    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:20:04.741769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.741748    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-bundle\") pod \"349bbd7d-5517-4324-b96e-f3122f3f7655\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") "
Sep 18 13:20:04.741901 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.741790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-util\") pod \"349bbd7d-5517-4324-b96e-f3122f3f7655\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") "
Sep 18 13:20:04.741901 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.741826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwxll\" (UniqueName: \"kubernetes.io/projected/349bbd7d-5517-4324-b96e-f3122f3f7655-kube-api-access-gwxll\") pod \"349bbd7d-5517-4324-b96e-f3122f3f7655\" (UID: \"349bbd7d-5517-4324-b96e-f3122f3f7655\") "
Sep 18 13:20:04.742370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.742343    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-bundle" (OuterVolumeSpecName: "bundle") pod "349bbd7d-5517-4324-b96e-f3122f3f7655" (UID: "349bbd7d-5517-4324-b96e-f3122f3f7655"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:20:04.743840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.743815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349bbd7d-5517-4324-b96e-f3122f3f7655-kube-api-access-gwxll" (OuterVolumeSpecName: "kube-api-access-gwxll") pod "349bbd7d-5517-4324-b96e-f3122f3f7655" (UID: "349bbd7d-5517-4324-b96e-f3122f3f7655"). InnerVolumeSpecName "kube-api-access-gwxll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:20:04.746304 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.746281    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-util" (OuterVolumeSpecName: "util") pod "349bbd7d-5517-4324-b96e-f3122f3f7655" (UID: "349bbd7d-5517-4324-b96e-f3122f3f7655"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:20:04.842204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.842172    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:04.842285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.842190    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/349bbd7d-5517-4324-b96e-f3122f3f7655-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:04.842285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:04.842217    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwxll\" (UniqueName: \"kubernetes.io/projected/349bbd7d-5517-4324-b96e-f3122f3f7655-kube-api-access-gwxll\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:05.479159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:05.479116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf" event={"ID":"349bbd7d-5517-4324-b96e-f3122f3f7655","Type":"ContainerDied","Data":"2320da3e958df2d5252eb07d633b74bd7dc574efbc1ff87188281bbe139316f9"}
Sep 18 13:20:05.479159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:05.479154    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2320da3e958df2d5252eb07d633b74bd7dc574efbc1ff87188281bbe139316f9"
Sep 18 13:20:05.479159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:05.479157    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x4xkf"
Sep 18 13:20:11.261166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:11.261129    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:12.866173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:12.866146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:13.185409 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185356    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"]
Sep 18 13:20:13.185616 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185605    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="util"
Sep 18 13:20:13.185657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185618    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="util"
Sep 18 13:20:13.185657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185626    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="pull"
Sep 18 13:20:13.185657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185632    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="pull"
Sep 18 13:20:13.185657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185638    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="extract"
Sep 18 13:20:13.185657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185643    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="extract"
Sep 18 13:20:13.185825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.185701    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="349bbd7d-5517-4324-b96e-f3122f3f7655" containerName="extract"
Sep 18 13:20:13.191586 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.191570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.195507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.195488    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:20:13.195629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.195612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x9vn4\""
Sep 18 13:20:13.196313 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.196294    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 18 13:20:13.204340 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.204318    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"]
Sep 18 13:20:13.295686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.295661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzgf\" (UniqueName: \"kubernetes.io/projected/1b9a2bab-b7de-441d-a072-940de8b8c4e3-kube-api-access-fgzgf\") pod \"cert-manager-operator-controller-manager-55c444bf86-5zrpn\" (UID: \"1b9a2bab-b7de-441d-a072-940de8b8c4e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.295771 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.295735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b9a2bab-b7de-441d-a072-940de8b8c4e3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5zrpn\" (UID: \"1b9a2bab-b7de-441d-a072-940de8b8c4e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.396296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.396274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzgf\" (UniqueName: \"kubernetes.io/projected/1b9a2bab-b7de-441d-a072-940de8b8c4e3-kube-api-access-fgzgf\") pod \"cert-manager-operator-controller-manager-55c444bf86-5zrpn\" (UID: \"1b9a2bab-b7de-441d-a072-940de8b8c4e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.396387 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.396322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b9a2bab-b7de-441d-a072-940de8b8c4e3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5zrpn\" (UID: \"1b9a2bab-b7de-441d-a072-940de8b8c4e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.396602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.396589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b9a2bab-b7de-441d-a072-940de8b8c4e3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5zrpn\" (UID: \"1b9a2bab-b7de-441d-a072-940de8b8c4e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.404944 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.404922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzgf\" (UniqueName: \"kubernetes.io/projected/1b9a2bab-b7de-441d-a072-940de8b8c4e3-kube-api-access-fgzgf\") pod \"cert-manager-operator-controller-manager-55c444bf86-5zrpn\" (UID: \"1b9a2bab-b7de-441d-a072-940de8b8c4e3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.500073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.500047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"
Sep 18 13:20:13.779212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:13.779120    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn"]
Sep 18 13:20:13.783703 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:13.783676    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9a2bab_b7de_441d_a072_940de8b8c4e3.slice/crio-37b2e9ec67fe75f9f030632cd15c0d535f035d1ecc454e0ab4b6151730ab5c2b WatchSource:0}: Error finding container 37b2e9ec67fe75f9f030632cd15c0d535f035d1ecc454e0ab4b6151730ab5c2b: Status 404 returned error can't find the container with id 37b2e9ec67fe75f9f030632cd15c0d535f035d1ecc454e0ab4b6151730ab5c2b
Sep 18 13:20:14.513905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:14.513872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn" event={"ID":"1b9a2bab-b7de-441d-a072-940de8b8c4e3","Type":"ContainerStarted","Data":"37b2e9ec67fe75f9f030632cd15c0d535f035d1ecc454e0ab4b6151730ab5c2b"}
Sep 18 13:20:15.080053 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:15.080020    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:15.177355 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:15.177320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:16.523099 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:16.523064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn" event={"ID":"1b9a2bab-b7de-441d-a072-940de8b8c4e3","Type":"ContainerStarted","Data":"e809060894449d34dfd89cdafc4196a22733983f1adad7941cf8b1c403e4b6de"}
Sep 18 13:20:16.548333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:16.548281    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5zrpn" podStartSLOduration=1.8373064650000002 podStartE2EDuration="3.548262604s" totalImagesPullingTime="1.710956139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:16.546664107 +0000 UTC m=+333.915923489" watchObservedRunningTime="2026-09-18 13:20:16.548262604 +0000 UTC m=+333.917521986"
Sep 18 13:20:16.949035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:16.948971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:17.128621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.128591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:17.611808 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.611778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:17.823065 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.823038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:17.841692 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.841666    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"]
Sep 18 13:20:17.845034 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.845012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:17.848228 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.848210    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tkn46\""
Sep 18 13:20:17.849381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.849367    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 13:20:17.849441 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.849369    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 13:20:17.885458 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.885411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"]
Sep 18 13:20:17.928513 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.928492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:17.928613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.928520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6s2l\" (UniqueName: \"kubernetes.io/projected/afca334d-de58-4210-b28f-4c9850809af8-kube-api-access-z6s2l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:17.928613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:17.928541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.029811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.029791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.029897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.029817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6s2l\" (UniqueName: \"kubernetes.io/projected/afca334d-de58-4210-b28f-4c9850809af8-kube-api-access-z6s2l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.029897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.029839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.030224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.030209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.030268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.030212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.048302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.048278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6s2l\" (UniqueName: \"kubernetes.io/projected/afca334d-de58-4210-b28f-4c9850809af8-kube-api-access-z6s2l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.153723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.153670    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:18.432353 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.432330    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"]
Sep 18 13:20:18.434756 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:18.434729    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafca334d_de58_4210_b28f_4c9850809af8.slice/crio-a7fd69ecc1b8dec0acbeeadf15da7360387aa6100b896d6f4a451cb1e0a3de81 WatchSource:0}: Error finding container a7fd69ecc1b8dec0acbeeadf15da7360387aa6100b896d6f4a451cb1e0a3de81: Status 404 returned error can't find the container with id a7fd69ecc1b8dec0acbeeadf15da7360387aa6100b896d6f4a451cb1e0a3de81
Sep 18 13:20:18.531902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.531873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx" event={"ID":"afca334d-de58-4210-b28f-4c9850809af8","Type":"ContainerStarted","Data":"c0694996ba8c95f4a9c7e1f0306214d0aa8a0e80b850c3ee5289401dd31f3cf0"}
Sep 18 13:20:18.532005 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:18.531933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx" event={"ID":"afca334d-de58-4210-b28f-4c9850809af8","Type":"ContainerStarted","Data":"a7fd69ecc1b8dec0acbeeadf15da7360387aa6100b896d6f4a451cb1e0a3de81"}
Sep 18 13:20:19.426618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:19.426555    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:19.542144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:19.542116    2564 generic.go:356] "Generic (PLEG): container finished" podID="afca334d-de58-4210-b28f-4c9850809af8" containerID="c0694996ba8c95f4a9c7e1f0306214d0aa8a0e80b850c3ee5289401dd31f3cf0" exitCode=0
Sep 18 13:20:19.542282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:19.542167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx" event={"ID":"afca334d-de58-4210-b28f-4c9850809af8","Type":"ContainerDied","Data":"c0694996ba8c95f4a9c7e1f0306214d0aa8a0e80b850c3ee5289401dd31f3cf0"}
Sep 18 13:20:19.944168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:19.944135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:20.321661 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.321627    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"]
Sep 18 13:20:20.324868 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.324850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.327448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.327428    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-spc5l\""
Sep 18 13:20:20.327560 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.327453    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 13:20:20.327560 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.327468    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 13:20:20.339223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.339182    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"]
Sep 18 13:20:20.446127 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.446101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a165a912-3932-4b3e-9a60-66413fec696d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cptnt\" (UID: \"a165a912-3932-4b3e-9a60-66413fec696d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.446563 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.446152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssbb\" (UniqueName: \"kubernetes.io/projected/a165a912-3932-4b3e-9a60-66413fec696d-kube-api-access-2ssbb\") pod \"cert-manager-cainjector-559cdd8c87-cptnt\" (UID: \"a165a912-3932-4b3e-9a60-66413fec696d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.547235 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.547182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a165a912-3932-4b3e-9a60-66413fec696d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cptnt\" (UID: \"a165a912-3932-4b3e-9a60-66413fec696d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.547385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.547266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssbb\" (UniqueName: \"kubernetes.io/projected/a165a912-3932-4b3e-9a60-66413fec696d-kube-api-access-2ssbb\") pod \"cert-manager-cainjector-559cdd8c87-cptnt\" (UID: \"a165a912-3932-4b3e-9a60-66413fec696d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.556155 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.556131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a165a912-3932-4b3e-9a60-66413fec696d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cptnt\" (UID: \"a165a912-3932-4b3e-9a60-66413fec696d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.556277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.556189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssbb\" (UniqueName: \"kubernetes.io/projected/a165a912-3932-4b3e-9a60-66413fec696d-kube-api-access-2ssbb\") pod \"cert-manager-cainjector-559cdd8c87-cptnt\" (UID: \"a165a912-3932-4b3e-9a60-66413fec696d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.635015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.634957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"
Sep 18 13:20:20.912528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:20.912369    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cptnt"]
Sep 18 13:20:21.352170 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:21.352133    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda165a912_3932_4b3e_9a60_66413fec696d.slice/crio-e299cc7131bf77400bb37f6a510ff7c1f610a2ae05e5f79b00e9c93d6cb4898a WatchSource:0}: Error finding container e299cc7131bf77400bb37f6a510ff7c1f610a2ae05e5f79b00e9c93d6cb4898a: Status 404 returned error can't find the container with id e299cc7131bf77400bb37f6a510ff7c1f610a2ae05e5f79b00e9c93d6cb4898a
Sep 18 13:20:21.553366 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:21.553339    2564 generic.go:356] "Generic (PLEG): container finished" podID="afca334d-de58-4210-b28f-4c9850809af8" containerID="eed36586e880be4f5b8e0eb0c4dce64d0bba955a236ad08863a486b65d9b04f5" exitCode=0
Sep 18 13:20:21.553712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:21.553413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx" event={"ID":"afca334d-de58-4210-b28f-4c9850809af8","Type":"ContainerDied","Data":"eed36586e880be4f5b8e0eb0c4dce64d0bba955a236ad08863a486b65d9b04f5"}
Sep 18 13:20:21.554696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:21.554663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt" event={"ID":"a165a912-3932-4b3e-9a60-66413fec696d","Type":"ContainerStarted","Data":"e299cc7131bf77400bb37f6a510ff7c1f610a2ae05e5f79b00e9c93d6cb4898a"}
Sep 18 13:20:22.067040 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:22.067002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:22.168532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:22.168492    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:22.563985 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:22.563953    2564 generic.go:356] "Generic (PLEG): container finished" podID="afca334d-de58-4210-b28f-4c9850809af8" containerID="27716627f0f1b2c4d918820bffca5b46dea785c33ef4dbfe9440acd3f22b5d7b" exitCode=0
Sep 18 13:20:22.564422 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:22.564021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx" event={"ID":"afca334d-de58-4210-b28f-4c9850809af8","Type":"ContainerDied","Data":"27716627f0f1b2c4d918820bffca5b46dea785c33ef4dbfe9440acd3f22b5d7b"}
Sep 18 13:20:23.757762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.757731    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:23.871419 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.871399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6s2l\" (UniqueName: \"kubernetes.io/projected/afca334d-de58-4210-b28f-4c9850809af8-kube-api-access-z6s2l\") pod \"afca334d-de58-4210-b28f-4c9850809af8\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") "
Sep 18 13:20:23.871658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.871445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-util\") pod \"afca334d-de58-4210-b28f-4c9850809af8\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") "
Sep 18 13:20:23.871658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.871489    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-bundle\") pod \"afca334d-de58-4210-b28f-4c9850809af8\" (UID: \"afca334d-de58-4210-b28f-4c9850809af8\") "
Sep 18 13:20:23.871890 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.871867    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-bundle" (OuterVolumeSpecName: "bundle") pod "afca334d-de58-4210-b28f-4c9850809af8" (UID: "afca334d-de58-4210-b28f-4c9850809af8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:20:23.873299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.873277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afca334d-de58-4210-b28f-4c9850809af8-kube-api-access-z6s2l" (OuterVolumeSpecName: "kube-api-access-z6s2l") pod "afca334d-de58-4210-b28f-4c9850809af8" (UID: "afca334d-de58-4210-b28f-4c9850809af8"). InnerVolumeSpecName "kube-api-access-z6s2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:20:23.905856 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.905813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-util" (OuterVolumeSpecName: "util") pod "afca334d-de58-4210-b28f-4c9850809af8" (UID: "afca334d-de58-4210-b28f-4c9850809af8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:20:23.972836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.972806    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6s2l\" (UniqueName: \"kubernetes.io/projected/afca334d-de58-4210-b28f-4c9850809af8-kube-api-access-z6s2l\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:23.972836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.972833    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:23.972957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:23.972846    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afca334d-de58-4210-b28f-4c9850809af8-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:24.574324 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.574294    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx"
Sep 18 13:20:24.574508 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.574293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4lwqx" event={"ID":"afca334d-de58-4210-b28f-4c9850809af8","Type":"ContainerDied","Data":"a7fd69ecc1b8dec0acbeeadf15da7360387aa6100b896d6f4a451cb1e0a3de81"}
Sep 18 13:20:24.574508 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.574403    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7fd69ecc1b8dec0acbeeadf15da7360387aa6100b896d6f4a451cb1e0a3de81"
Sep 18 13:20:24.575942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.575903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt" event={"ID":"a165a912-3932-4b3e-9a60-66413fec696d","Type":"ContainerStarted","Data":"0bbb7f8d625021cf326567cf703900b3860a41d09b7b8b46393c2365d7fd9b85"}
Sep 18 13:20:24.593501 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.593462    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cptnt" podStartSLOduration=2.146394522 podStartE2EDuration="4.593449269s" totalImagesPullingTime="2.447054747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:24.592059809 +0000 UTC m=+341.961319190" watchObservedRunningTime="2026-09-18 13:20:24.593449269 +0000 UTC m=+341.962708648"
Sep 18 13:20:24.604934 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.604911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:24.679899 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:24.679870    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:28.312954 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:28.312922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:31.479207 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:31.479168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:31.576090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:31.576054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:33.182873 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.182845    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"]
Sep 18 13:20:33.183226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183110    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="extract"
Sep 18 13:20:33.183226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183121    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="extract"
Sep 18 13:20:33.183226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183143    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="pull"
Sep 18 13:20:33.183226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183149    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="pull"
Sep 18 13:20:33.183226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183159    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="util"
Sep 18 13:20:33.183226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183164    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="util"
Sep 18 13:20:33.183411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.183231    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="afca334d-de58-4210-b28f-4c9850809af8" containerName="extract"
Sep 18 13:20:33.187918 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.187902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.190897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.190878    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:20:33.191025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.191009    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 13:20:33.192012 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.191996    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-c9qzl\""
Sep 18 13:20:33.196580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.196561    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"]
Sep 18 13:20:33.333049 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.333026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e9250a-613d-426d-ac05-7f50388659ad-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x48vc\" (UID: \"58e9250a-613d-426d-ac05-7f50388659ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.333144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.333085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmll7\" (UniqueName: \"kubernetes.io/projected/58e9250a-613d-426d-ac05-7f50388659ad-kube-api-access-wmll7\") pod \"openshift-lws-operator-fd8ccff4c-x48vc\" (UID: \"58e9250a-613d-426d-ac05-7f50388659ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.433971 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.433907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmll7\" (UniqueName: \"kubernetes.io/projected/58e9250a-613d-426d-ac05-7f50388659ad-kube-api-access-wmll7\") pod \"openshift-lws-operator-fd8ccff4c-x48vc\" (UID: \"58e9250a-613d-426d-ac05-7f50388659ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.434069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.433985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e9250a-613d-426d-ac05-7f50388659ad-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x48vc\" (UID: \"58e9250a-613d-426d-ac05-7f50388659ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.434397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.434376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58e9250a-613d-426d-ac05-7f50388659ad-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x48vc\" (UID: \"58e9250a-613d-426d-ac05-7f50388659ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.443352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.443332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmll7\" (UniqueName: \"kubernetes.io/projected/58e9250a-613d-426d-ac05-7f50388659ad-kube-api-access-wmll7\") pod \"openshift-lws-operator-fd8ccff4c-x48vc\" (UID: \"58e9250a-613d-426d-ac05-7f50388659ad\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.496611 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.496582    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"
Sep 18 13:20:33.767938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:33.767914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc"]
Sep 18 13:20:33.769842 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:33.769816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58e9250a_613d_426d_ac05_7f50388659ad.slice/crio-216cb0756f6aadd7450ce72ffcd875d87c326d78f17c9b5e718a5194baad895e WatchSource:0}: Error finding container 216cb0756f6aadd7450ce72ffcd875d87c326d78f17c9b5e718a5194baad895e: Status 404 returned error can't find the container with id 216cb0756f6aadd7450ce72ffcd875d87c326d78f17c9b5e718a5194baad895e
Sep 18 13:20:34.616818 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:34.616773    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc" event={"ID":"58e9250a-613d-426d-ac05-7f50388659ad","Type":"ContainerStarted","Data":"216cb0756f6aadd7450ce72ffcd875d87c326d78f17c9b5e718a5194baad895e"}
Sep 18 13:20:35.623567 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:35.623485    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc" event={"ID":"58e9250a-613d-426d-ac05-7f50388659ad","Type":"ContainerStarted","Data":"71dc95e9287123182fd9b78dfdcc2a6cee5f95fff16007b7b465200ae35c4bbb"}
Sep 18 13:20:35.646062 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:35.646017    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x48vc" podStartSLOduration=1.093922762 podStartE2EDuration="2.646003063s" totalImagesPullingTime="1.552080301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:20:35.64446853 +0000 UTC m=+353.013727913" watchObservedRunningTime="2026-09-18 13:20:35.646003063 +0000 UTC m=+353.015262444"
Sep 18 13:20:36.344946 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:36.344912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:36.435912 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:36.435882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:38.338307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.338265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:38.493123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.493094    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"]
Sep 18 13:20:38.515229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.515188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"]
Sep 18 13:20:38.515359 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.515325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.518407 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.518384    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 13:20:38.519250 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.519230    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tkn46\""
Sep 18 13:20:38.519359 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.519236    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 13:20:38.678272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.678217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.678272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.678270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.678406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.678293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl8t8\" (UniqueName: \"kubernetes.io/projected/e7e5d57a-b886-4d1e-9023-a43436414f73-kube-api-access-vl8t8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.779384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.779360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.779468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.779389    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl8t8\" (UniqueName: \"kubernetes.io/projected/e7e5d57a-b886-4d1e-9023-a43436414f73-kube-api-access-vl8t8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.779468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.779431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.779780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.779760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.779829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.779776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.789704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.789678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl8t8\" (UniqueName: \"kubernetes.io/projected/e7e5d57a-b886-4d1e-9023-a43436414f73-kube-api-access-vl8t8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:38.824943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:38.824920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:39.100567 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:39.100541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"]
Sep 18 13:20:39.102589 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:39.102556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e5d57a_b886_4d1e_9023_a43436414f73.slice/crio-6a81382a33e115462045ab31392bbb9b5f699a12727b0aabdc7371a1c33929cb WatchSource:0}: Error finding container 6a81382a33e115462045ab31392bbb9b5f699a12727b0aabdc7371a1c33929cb: Status 404 returned error can't find the container with id 6a81382a33e115462045ab31392bbb9b5f699a12727b0aabdc7371a1c33929cb
Sep 18 13:20:39.647531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:39.647506    2564 generic.go:356] "Generic (PLEG): container finished" podID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerID="c5efa8206f6261cc1034fc258ddb94531d64f41203165b6bf7c3013274c7c4cc" exitCode=0
Sep 18 13:20:39.647860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:39.647580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg" event={"ID":"e7e5d57a-b886-4d1e-9023-a43436414f73","Type":"ContainerDied","Data":"c5efa8206f6261cc1034fc258ddb94531d64f41203165b6bf7c3013274c7c4cc"}
Sep 18 13:20:39.647860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:39.647619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg" event={"ID":"e7e5d57a-b886-4d1e-9023-a43436414f73","Type":"ContainerStarted","Data":"6a81382a33e115462045ab31392bbb9b5f699a12727b0aabdc7371a1c33929cb"}
Sep 18 13:20:40.654175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:40.654115    2564 generic.go:356] "Generic (PLEG): container finished" podID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerID="dfaa308ae3bf1de95c95c386b52b0f36e121a3a258cf62c4d1447b8e4110d344" exitCode=0
Sep 18 13:20:40.654477 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:40.654207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg" event={"ID":"e7e5d57a-b886-4d1e-9023-a43436414f73","Type":"ContainerDied","Data":"dfaa308ae3bf1de95c95c386b52b0f36e121a3a258cf62c4d1447b8e4110d344"}
Sep 18 13:20:41.662864 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:41.662829    2564 generic.go:356] "Generic (PLEG): container finished" podID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerID="047d3d76bacc89ea37307e0a1fa0b2775f45fe7376c6524a401ce090565d1db4" exitCode=0
Sep 18 13:20:41.663209 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:41.662907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg" event={"ID":"e7e5d57a-b886-4d1e-9023-a43436414f73","Type":"ContainerDied","Data":"047d3d76bacc89ea37307e0a1fa0b2775f45fe7376c6524a401ce090565d1db4"}
Sep 18 13:20:42.787006 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.786983    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:42.913686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.913658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-util\") pod \"e7e5d57a-b886-4d1e-9023-a43436414f73\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") "
Sep 18 13:20:42.913798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.913708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-bundle\") pod \"e7e5d57a-b886-4d1e-9023-a43436414f73\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") "
Sep 18 13:20:42.913798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.913738    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl8t8\" (UniqueName: \"kubernetes.io/projected/e7e5d57a-b886-4d1e-9023-a43436414f73-kube-api-access-vl8t8\") pod \"e7e5d57a-b886-4d1e-9023-a43436414f73\" (UID: \"e7e5d57a-b886-4d1e-9023-a43436414f73\") "
Sep 18 13:20:42.914406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.914381    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-bundle" (OuterVolumeSpecName: "bundle") pod "e7e5d57a-b886-4d1e-9023-a43436414f73" (UID: "e7e5d57a-b886-4d1e-9023-a43436414f73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:20:42.915671 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.915641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e5d57a-b886-4d1e-9023-a43436414f73-kube-api-access-vl8t8" (OuterVolumeSpecName: "kube-api-access-vl8t8") pod "e7e5d57a-b886-4d1e-9023-a43436414f73" (UID: "e7e5d57a-b886-4d1e-9023-a43436414f73"). InnerVolumeSpecName "kube-api-access-vl8t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:20:42.919139 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:42.919097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-util" (OuterVolumeSpecName: "util") pod "e7e5d57a-b886-4d1e-9023-a43436414f73" (UID: "e7e5d57a-b886-4d1e-9023-a43436414f73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:20:43.014798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:43.014777    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:43.014798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:43.014797    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e5d57a-b886-4d1e-9023-a43436414f73-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:43.014910 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:43.014807    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl8t8\" (UniqueName: \"kubernetes.io/projected/e7e5d57a-b886-4d1e-9023-a43436414f73-kube-api-access-vl8t8\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:20:43.673255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:43.673226    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg" event={"ID":"e7e5d57a-b886-4d1e-9023-a43436414f73","Type":"ContainerDied","Data":"6a81382a33e115462045ab31392bbb9b5f699a12727b0aabdc7371a1c33929cb"}
Sep 18 13:20:43.673354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:43.673266    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67lkg"
Sep 18 13:20:43.673354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:43.673271    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a81382a33e115462045ab31392bbb9b5f699a12727b0aabdc7371a1c33929cb"
Sep 18 13:20:55.092248 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092216    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"]
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092487    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="extract"
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092497    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="extract"
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092517    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="pull"
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092522    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="pull"
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092531    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="util"
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092537    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="util"
Sep 18 13:20:55.092666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.092584    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e5d57a-b886-4d1e-9023-a43436414f73" containerName="extract"
Sep 18 13:20:55.139518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.139491    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"]
Sep 18 13:20:55.139651 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.139583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.142135 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.142112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 13:20:55.142256 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.142119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tkn46\""
Sep 18 13:20:55.143146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.143125    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 13:20:55.192847 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.192824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k828h\" (UniqueName: \"kubernetes.io/projected/3d293f8f-b4db-4159-aff2-607cf2a13a70-kube-api-access-k828h\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.192950 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.192859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.192950 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.192894    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.281054 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.281024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:55.294064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.294040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.294173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.294105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k828h\" (UniqueName: \"kubernetes.io/projected/3d293f8f-b4db-4159-aff2-607cf2a13a70-kube-api-access-k828h\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.294173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.294141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.294479 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.294461    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.294558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.294486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.316665 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.316637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k828h\" (UniqueName: \"kubernetes.io/projected/3d293f8f-b4db-4159-aff2-607cf2a13a70-kube-api-access-k828h\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.384004 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.383940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:55.448901 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.448875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:20:55.740330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.740266    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"]
Sep 18 13:20:55.742391 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:55.742370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d293f8f_b4db_4159_aff2_607cf2a13a70.slice/crio-ee91c940ac0977063ed7304369f8f71dc3c272c5148221f6b049c8e8bf8b5ccf WatchSource:0}: Error finding container ee91c940ac0977063ed7304369f8f71dc3c272c5148221f6b049c8e8bf8b5ccf: Status 404 returned error can't find the container with id ee91c940ac0977063ed7304369f8f71dc3c272c5148221f6b049c8e8bf8b5ccf
Sep 18 13:20:55.958726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:55.958695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:56.377544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.377507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:56.480382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.480334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:56.517774 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.517750    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"]
Sep 18 13:20:56.520347 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.520333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.526181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.526161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 13:20:56.526688 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.526368    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 13:20:56.526688 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.526641    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 13:20:56.527024 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.526998    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 13:20:56.527096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.527058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-krfj5\""
Sep 18 13:20:56.538211 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.537007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"]
Sep 18 13:20:56.602400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.602341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24ed932e-334f-4e36-ae94-61ea7287cb3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.602400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.602380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ed932e-334f-4e36-ae94-61ea7287cb3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.602528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.602413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24ed932e-334f-4e36-ae94-61ea7287cb3f-manifests\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.602528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.602460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24ed932e-334f-4e36-ae94-61ea7287cb3f-tmp\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.602528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.602508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsm6l\" (UniqueName: \"kubernetes.io/projected/24ed932e-334f-4e36-ae94-61ea7287cb3f-kube-api-access-wsm6l\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.703355 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.703327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ed932e-334f-4e36-ae94-61ea7287cb3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.703457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.703376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24ed932e-334f-4e36-ae94-61ea7287cb3f-manifests\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.703457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.703399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24ed932e-334f-4e36-ae94-61ea7287cb3f-tmp\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.703570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.703462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsm6l\" (UniqueName: \"kubernetes.io/projected/24ed932e-334f-4e36-ae94-61ea7287cb3f-kube-api-access-wsm6l\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.703570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.703501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24ed932e-334f-4e36-ae94-61ea7287cb3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.703793 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.703759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24ed932e-334f-4e36-ae94-61ea7287cb3f-manifests\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.705775 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.705749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24ed932e-334f-4e36-ae94-61ea7287cb3f-tmp\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.705865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.705847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ed932e-334f-4e36-ae94-61ea7287cb3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.705916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.705889    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24ed932e-334f-4e36-ae94-61ea7287cb3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.724050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.724030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsm6l\" (UniqueName: \"kubernetes.io/projected/24ed932e-334f-4e36-ae94-61ea7287cb3f-kube-api-access-wsm6l\") pod \"opendatahub-operator-controller-manager-854585bc8d-5ntpw\" (UID: \"24ed932e-334f-4e36-ae94-61ea7287cb3f\") " pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.731875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.731854    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerID="f40e7138f6803f6dc831ec03e42ecb7bbe3bab57a530d9c4869ebb157cebe803" exitCode=0
Sep 18 13:20:56.731961 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.731934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57" event={"ID":"3d293f8f-b4db-4159-aff2-607cf2a13a70","Type":"ContainerDied","Data":"f40e7138f6803f6dc831ec03e42ecb7bbe3bab57a530d9c4869ebb157cebe803"}
Sep 18 13:20:56.732008 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.731987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57" event={"ID":"3d293f8f-b4db-4159-aff2-607cf2a13a70","Type":"ContainerStarted","Data":"ee91c940ac0977063ed7304369f8f71dc3c272c5148221f6b049c8e8bf8b5ccf"}
Sep 18 13:20:56.752326 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.752295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:56.829748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.829725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:20:56.843772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.843748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:56.948289 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:56.948261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:57.145032 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.144969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:57.146296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.146275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"]
Sep 18 13:20:57.152614 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:20:57.152593    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ed932e_334f_4e36_ae94_61ea7287cb3f.slice/crio-0684cad95ba7883a42a7b203072433daea4f4f4df4e518f697a64b729887eea8 WatchSource:0}: Error finding container 0684cad95ba7883a42a7b203072433daea4f4f4df4e518f697a64b729887eea8: Status 404 returned error can't find the container with id 0684cad95ba7883a42a7b203072433daea4f4f4df4e518f697a64b729887eea8
Sep 18 13:20:57.274057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.274027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:57.384590 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.384559    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:57.499525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.499504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:20:57.739884 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.739854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw" event={"ID":"24ed932e-334f-4e36-ae94-61ea7287cb3f","Type":"ContainerStarted","Data":"0684cad95ba7883a42a7b203072433daea4f4f4df4e518f697a64b729887eea8"}
Sep 18 13:20:57.741995 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.741967    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerID="68e29d59774c897ccb606a1a647e4c06f26fe23cef99415a574c0edb13668e53" exitCode=0
Sep 18 13:20:57.742125 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:57.742038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57" event={"ID":"3d293f8f-b4db-4159-aff2-607cf2a13a70","Type":"ContainerDied","Data":"68e29d59774c897ccb606a1a647e4c06f26fe23cef99415a574c0edb13668e53"}
Sep 18 13:20:58.749680 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:58.749639    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerID="57733d1cbf9f3e22f3f3aa6d0ab231d8b3e34721423b657e025fdf3eba8bd366" exitCode=0
Sep 18 13:20:58.750148 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:20:58.749688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57" event={"ID":"3d293f8f-b4db-4159-aff2-607cf2a13a70","Type":"ContainerDied","Data":"57733d1cbf9f3e22f3f3aa6d0ab231d8b3e34721423b657e025fdf3eba8bd366"}
Sep 18 13:21:00.171491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.171468    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:21:00.230935 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.230913    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-util\") pod \"3d293f8f-b4db-4159-aff2-607cf2a13a70\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") "
Sep 18 13:21:00.231030 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.230949    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k828h\" (UniqueName: \"kubernetes.io/projected/3d293f8f-b4db-4159-aff2-607cf2a13a70-kube-api-access-k828h\") pod \"3d293f8f-b4db-4159-aff2-607cf2a13a70\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") "
Sep 18 13:21:00.231030 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.230989    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-bundle\") pod \"3d293f8f-b4db-4159-aff2-607cf2a13a70\" (UID: \"3d293f8f-b4db-4159-aff2-607cf2a13a70\") "
Sep 18 13:21:00.231893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.231863    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-bundle" (OuterVolumeSpecName: "bundle") pod "3d293f8f-b4db-4159-aff2-607cf2a13a70" (UID: "3d293f8f-b4db-4159-aff2-607cf2a13a70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:21:00.232879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.232858    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d293f8f-b4db-4159-aff2-607cf2a13a70-kube-api-access-k828h" (OuterVolumeSpecName: "kube-api-access-k828h") pod "3d293f8f-b4db-4159-aff2-607cf2a13a70" (UID: "3d293f8f-b4db-4159-aff2-607cf2a13a70"). InnerVolumeSpecName "kube-api-access-k828h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:21:00.237041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.237019    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-util" (OuterVolumeSpecName: "util") pod "3d293f8f-b4db-4159-aff2-607cf2a13a70" (UID: "3d293f8f-b4db-4159-aff2-607cf2a13a70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:21:00.331439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.331414    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:00.331439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.331438    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d293f8f-b4db-4159-aff2-607cf2a13a70-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:00.331564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.331447    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k828h\" (UniqueName: \"kubernetes.io/projected/3d293f8f-b4db-4159-aff2-607cf2a13a70-kube-api-access-k828h\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:00.761204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.761155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw" event={"ID":"24ed932e-334f-4e36-ae94-61ea7287cb3f","Type":"ContainerStarted","Data":"09b009552f2d9d2307e90581b260a3a76259be678a730de3f84149b38882115d"}
Sep 18 13:21:00.762982 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.762962    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57"
Sep 18 13:21:00.762982 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.762974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp57" event={"ID":"3d293f8f-b4db-4159-aff2-607cf2a13a70","Type":"ContainerDied","Data":"ee91c940ac0977063ed7304369f8f71dc3c272c5148221f6b049c8e8bf8b5ccf"}
Sep 18 13:21:00.763129 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:00.763006    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee91c940ac0977063ed7304369f8f71dc3c272c5148221f6b049c8e8bf8b5ccf"
Sep 18 13:21:01.770539 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:01.770509    2564 generic.go:356] "Generic (PLEG): container finished" podID="24ed932e-334f-4e36-ae94-61ea7287cb3f" containerID="09b009552f2d9d2307e90581b260a3a76259be678a730de3f84149b38882115d" exitCode=0
Sep 18 13:21:01.770897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:01.770598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw" event={"ID":"24ed932e-334f-4e36-ae94-61ea7287cb3f","Type":"ContainerDied","Data":"09b009552f2d9d2307e90581b260a3a76259be678a730de3f84149b38882115d"}
Sep 18 13:21:02.776725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:02.776684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw" event={"ID":"24ed932e-334f-4e36-ae94-61ea7287cb3f","Type":"ContainerStarted","Data":"d07b090f26f38ce253f3b9fbef1ed8978c53f68ea77b0aa377b61773e2cee797"}
Sep 18 13:21:02.777072 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:02.776782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:21:02.803141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:02.803095    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw" podStartSLOduration=2.176834869 podStartE2EDuration="6.803084278s" totalImagesPullingTime="3.557345789s" totalInitContainerRuntime="1.06890362s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:20:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:02.800583126 +0000 UTC m=+380.169842510" watchObservedRunningTime="2026-09-18 13:21:02.803084278 +0000 UTC m=+380.172343660"
Sep 18 13:21:04.595985 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:04.595946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:04.680644 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:04.680612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:08.144093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:08.144059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:08.247989 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:08.247960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:12.489977 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.489947    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79c75b8ff7-wzrqd"]
Sep 18 13:21:12.490334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490255    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="util"
Sep 18 13:21:12.490334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490266    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="util"
Sep 18 13:21:12.490334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490278    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="extract"
Sep 18 13:21:12.490334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490283    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="extract"
Sep 18 13:21:12.490334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490308    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="pull"
Sep 18 13:21:12.490334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490314    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="pull"
Sep 18 13:21:12.490519 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.490378    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d293f8f-b4db-4159-aff2-607cf2a13a70" containerName="extract"
Sep 18 13:21:12.494776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.494759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.517161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.517131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c75b8ff7-wzrqd"]
Sep 18 13:21:12.519177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-console-config\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.519285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-service-ca\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.519285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/880e77b8-91dc-468a-ab36-9ff0def575b8-console-serving-cert\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.519402 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-oauth-serving-cert\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.519402 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/880e77b8-91dc-468a-ab36-9ff0def575b8-console-oauth-config\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.519497 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-trusted-ca-bundle\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.519497 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.519458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt898\" (UniqueName: \"kubernetes.io/projected/880e77b8-91dc-468a-ab36-9ff0def575b8-kube-api-access-pt898\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.553451 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.553426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:12.616927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.616887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:12.619832 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.619812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/880e77b8-91dc-468a-ab36-9ff0def575b8-console-oauth-config\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.619915 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.619852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-trusted-ca-bundle\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.619915 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.619885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt898\" (UniqueName: \"kubernetes.io/projected/880e77b8-91dc-468a-ab36-9ff0def575b8-kube-api-access-pt898\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620061 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.619937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-console-config\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620061 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.619965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-service-ca\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620061 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.620054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/880e77b8-91dc-468a-ab36-9ff0def575b8-console-serving-cert\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.620082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-oauth-serving-cert\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.620686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-console-config\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620808 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.620740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-service-ca\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.620930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.620907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-oauth-serving-cert\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.621006 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.620980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/880e77b8-91dc-468a-ab36-9ff0def575b8-trusted-ca-bundle\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.622348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.622326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/880e77b8-91dc-468a-ab36-9ff0def575b8-console-oauth-config\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.622483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.622463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/880e77b8-91dc-468a-ab36-9ff0def575b8-console-serving-cert\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.630423 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.630405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt898\" (UniqueName: \"kubernetes.io/projected/880e77b8-91dc-468a-ab36-9ff0def575b8-kube-api-access-pt898\") pod \"console-79c75b8ff7-wzrqd\" (UID: \"880e77b8-91dc-468a-ab36-9ff0def575b8\") " pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:12.803301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:12.803257    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:13.082246 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:13.082216    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c75b8ff7-wzrqd"]
Sep 18 13:21:13.083912 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:21:13.083890    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880e77b8_91dc_468a_ab36_9ff0def575b8.slice/crio-6fb0fcf61cd0793279799a0f906b3c4676dc12d354c6da670ed6371e72dcb11e WatchSource:0}: Error finding container 6fb0fcf61cd0793279799a0f906b3c4676dc12d354c6da670ed6371e72dcb11e: Status 404 returned error can't find the container with id 6fb0fcf61cd0793279799a0f906b3c4676dc12d354c6da670ed6371e72dcb11e
Sep 18 13:21:13.783142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:13.783111    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-854585bc8d-5ntpw"
Sep 18 13:21:13.828945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:13.828901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c75b8ff7-wzrqd" event={"ID":"880e77b8-91dc-468a-ab36-9ff0def575b8","Type":"ContainerStarted","Data":"e8079620d7d0b3e5d680d40b91bc668d06580ce4f889846f3a800cb0c01bfae5"}
Sep 18 13:21:13.829093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:13.828953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c75b8ff7-wzrqd" event={"ID":"880e77b8-91dc-468a-ab36-9ff0def575b8","Type":"ContainerStarted","Data":"6fb0fcf61cd0793279799a0f906b3c4676dc12d354c6da670ed6371e72dcb11e"}
Sep 18 13:21:13.851108 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:13.851046    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79c75b8ff7-wzrqd" podStartSLOduration=1.851027601 podStartE2EDuration="1.851027601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:13.849855665 +0000 UTC m=+391.219115073" watchObservedRunningTime="2026-09-18 13:21:13.851027601 +0000 UTC m=+391.220286984"
Sep 18 13:21:15.768965 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:15.768932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:15.991167 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:15.991131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:16.271181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.271146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:16.276222 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.276189    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"]
Sep 18 13:21:16.279606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.279590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.297780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.297758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 18 13:21:16.297865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.297766    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 18 13:21:16.310337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.310318    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9d854\""
Sep 18 13:21:16.351266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.351229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d49413f-965a-4887-b549-529f8e4bf0fb-tmp\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.351379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.351314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d49413f-965a-4887-b549-529f8e4bf0fb-tls-certs\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.351379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.351341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxw66\" (UniqueName: \"kubernetes.io/projected/8d49413f-965a-4887-b549-529f8e4bf0fb-kube-api-access-gxw66\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.412831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.412808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"]
Sep 18 13:21:16.452327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.452304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d49413f-965a-4887-b549-529f8e4bf0fb-tls-certs\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.452432 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.452331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxw66\" (UniqueName: \"kubernetes.io/projected/8d49413f-965a-4887-b549-529f8e4bf0fb-kube-api-access-gxw66\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.452432 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.452365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d49413f-965a-4887-b549-529f8e4bf0fb-tmp\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.454542 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.454519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d49413f-965a-4887-b549-529f8e4bf0fb-tmp\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.454725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.454708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d49413f-965a-4887-b549-529f8e4bf0fb-tls-certs\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.470482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.470459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxw66\" (UniqueName: \"kubernetes.io/projected/8d49413f-965a-4887-b549-529f8e4bf0fb-kube-api-access-gxw66\") pod \"kube-auth-proxy-7c5fc7c97f-kdwxp\" (UID: \"8d49413f-965a-4887-b549-529f8e4bf0fb\") " pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.518063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.518037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:16.588852 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.588805    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"
Sep 18 13:21:16.866757 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:16.866730    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp"]
Sep 18 13:21:16.869045 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:21:16.869019    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d49413f_965a_4887_b549_529f8e4bf0fb.slice/crio-8ace23ac0c4446bb504da1d6e923ad6bc3110af06df52590bacac21d07d7250e WatchSource:0}: Error finding container 8ace23ac0c4446bb504da1d6e923ad6bc3110af06df52590bacac21d07d7250e: Status 404 returned error can't find the container with id 8ace23ac0c4446bb504da1d6e923ad6bc3110af06df52590bacac21d07d7250e
Sep 18 13:21:17.852939 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:17.852904    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp" event={"ID":"8d49413f-965a-4887-b549-529f8e4bf0fb","Type":"ContainerStarted","Data":"8ace23ac0c4446bb504da1d6e923ad6bc3110af06df52590bacac21d07d7250e"}
Sep 18 13:21:18.655886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.655829    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:18.699570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.699543    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"]
Sep 18 13:21:18.706832 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.706809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.713387 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.713351    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 13:21:18.713578 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.713360    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 13:21:18.713578 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.713521    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c66ql\""
Sep 18 13:21:18.714055 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.714036    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 13:21:18.714302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.714284    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 13:21:18.748660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.748633    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"]
Sep 18 13:21:18.770455 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tz9r\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-kube-api-access-5tz9r\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.770580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.770580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.770703 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.770703 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.770814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.770814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.770767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75eb7e8a-9b9b-4de6-8c90-e0f028371521-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.857442 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.857398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:18.871576 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.871696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.871696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.871696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75eb7e8a-9b9b-4de6-8c90-e0f028371521-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.871875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tz9r\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-kube-api-access-5tz9r\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.871927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.871980 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.871944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.872284 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.872259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.874316 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.874294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.874455 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.874438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75eb7e8a-9b9b-4de6-8c90-e0f028371521-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.874623 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.874600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.874734 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.874715    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.889268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.889248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tz9r\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-kube-api-access-5tz9r\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:18.890210 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:18.890177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zc2wh\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:19.018885 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:19.018857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:20.189451 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:20.189428    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"]
Sep 18 13:21:20.189937 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:21:20.189917    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75eb7e8a_9b9b_4de6_8c90_e0f028371521.slice/crio-4c5cc257a2e5d2d8217e3fd0fd9fa06e75f41704d756816417b18fb0f38027cd WatchSource:0}: Error finding container 4c5cc257a2e5d2d8217e3fd0fd9fa06e75f41704d756816417b18fb0f38027cd: Status 404 returned error can't find the container with id 4c5cc257a2e5d2d8217e3fd0fd9fa06e75f41704d756816417b18fb0f38027cd
Sep 18 13:21:20.536261 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:20.536234    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:20.870934 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:20.870867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" event={"ID":"75eb7e8a-9b9b-4de6-8c90-e0f028371521","Type":"ContainerStarted","Data":"4c5cc257a2e5d2d8217e3fd0fd9fa06e75f41704d756816417b18fb0f38027cd"}
Sep 18 13:21:20.872367 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:20.872346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp" event={"ID":"8d49413f-965a-4887-b549-529f8e4bf0fb","Type":"ContainerStarted","Data":"1182d3f719dd4efd2143dddaacf9cf8704cdb757d980cfb86323553012a18286"}
Sep 18 13:21:20.900747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:20.900701    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp" podStartSLOduration=1.794405177 podStartE2EDuration="4.900685889s" totalImagesPullingTime="3.106280712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:20.900170286 +0000 UTC m=+398.269429669" watchObservedRunningTime="2026-09-18 13:21:20.900685889 +0000 UTC m=+398.269945312"
Sep 18 13:21:22.804087 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.804051    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:22.804515 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.804104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:22.809020 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.808994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:22.892522 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.892496    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79c75b8ff7-wzrqd"
Sep 18 13:21:22.896667 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.896634    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:21:22.896839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.896695    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:21:22.943457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:22.943435    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5556f5bf6f-dvvxj"]
Sep 18 13:21:23.064509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.064418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:23.123823 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.123775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:23.185442 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.185416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:23.657781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.657747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:23.756933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.756899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:23.889512 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.889477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" event={"ID":"75eb7e8a-9b9b-4de6-8c90-e0f028371521","Type":"ContainerStarted","Data":"858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9"}
Sep 18 13:21:23.889941 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.889783    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:23.891311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.891283    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zc2wh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 13:21:23.891453 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.891348    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" podUID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 13:21:23.913592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:23.913514    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" podStartSLOduration=3.20897968 podStartE2EDuration="5.913502325s" totalImagesPullingTime="2.704522645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:23.911518748 +0000 UTC m=+401.280778142" watchObservedRunningTime="2026-09-18 13:21:23.913502325 +0000 UTC m=+401.282761706"
Sep 18 13:21:24.357925 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:24.357896    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:24.591925 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:24.591894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:24.894694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:24.894667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:24.988796 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:24.988762    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:27.935241 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:27.935206    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:28.032408 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:28.032376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:28.135491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:28.135463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:28.307677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:28.307646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:28.518204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:28.518167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:28.615734 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:28.615665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:38.719010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:38.718974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:38.914877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:38.914842    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"]
Sep 18 13:21:38.918175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:38.918151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:38.923705 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:38.923684    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pqcxh\""
Sep 18 13:21:38.949543 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:38.949522    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 18 13:21:38.966595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:38.966573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"]
Sep 18 13:21:39.009438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.009407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:39.016368 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.016348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/910ba23e-5954-489f-8450-62963ac09a20-cert\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.016470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.016397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmkk7\" (UniqueName: \"kubernetes.io/projected/910ba23e-5954-489f-8450-62963ac09a20-kube-api-access-lmkk7\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.117760 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.117738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/910ba23e-5954-489f-8450-62963ac09a20-cert\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.117848 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.117780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmkk7\" (UniqueName: \"kubernetes.io/projected/910ba23e-5954-489f-8450-62963ac09a20-kube-api-access-lmkk7\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.117900 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:21:39.117873    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 18 13:21:39.117935 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:21:39.117928    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/910ba23e-5954-489f-8450-62963ac09a20-cert podName:910ba23e-5954-489f-8450-62963ac09a20 nodeName:}" failed. No retries permitted until 2026-09-18 13:21:39.617913188 +0000 UTC m=+416.987172547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/910ba23e-5954-489f-8450-62963ac09a20-cert") pod "kserve-controller-manager-d6f4b65b8-4fdz6" (UID: "910ba23e-5954-489f-8450-62963ac09a20") : secret "kserve-webhook-server-cert" not found
Sep 18 13:21:39.158102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.158073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmkk7\" (UniqueName: \"kubernetes.io/projected/910ba23e-5954-489f-8450-62963ac09a20-kube-api-access-lmkk7\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.457984 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.457888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:39.614493 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.614464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:39.621819 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.621795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/910ba23e-5954-489f-8450-62963ac09a20-cert\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.624047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.624024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/910ba23e-5954-489f-8450-62963ac09a20-cert\") pod \"kserve-controller-manager-d6f4b65b8-4fdz6\" (UID: \"910ba23e-5954-489f-8450-62963ac09a20\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:39.827761 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:39.827737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:40.187013 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.186931    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"]
Sep 18 13:21:40.187207 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.187165    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" podUID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" containerName="discovery" containerID="cri-o://858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9" gracePeriod=30
Sep 18 13:21:40.212649 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.212623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"]
Sep 18 13:21:40.213588 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:21:40.213559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910ba23e_5954_489f_8450_62963ac09a20.slice/crio-8a7c9b6ad9a8b003d48e826fdde583a02ac1eef99fb511d744fc474837b9c77e WatchSource:0}: Error finding container 8a7c9b6ad9a8b003d48e826fdde583a02ac1eef99fb511d744fc474837b9c77e: Status 404 returned error can't find the container with id 8a7c9b6ad9a8b003d48e826fdde583a02ac1eef99fb511d744fc474837b9c77e
Sep 18 13:21:40.426722 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.426703    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:40.456733 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.456678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:40.528966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.528938    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-dns-cert\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.528974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tz9r\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-kube-api-access-5tz9r\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.529016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-ca-configmap\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.529067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-cacerts\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.529107    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-token\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529238 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.529142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-kubeconfig\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529238 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.529175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75eb7e8a-9b9b-4de6-8c90-e0f028371521-local-certs\") pod \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\" (UID: \"75eb7e8a-9b9b-4de6-8c90-e0f028371521\") "
Sep 18 13:21:40.529528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.529492    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:21:40.531860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.531825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:21:40.531955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.531853    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75eb7e8a-9b9b-4de6-8c90-e0f028371521-local-certs" (OuterVolumeSpecName: "local-certs") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:21:40.531955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.531881    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-kube-api-access-5tz9r" (OuterVolumeSpecName: "kube-api-access-5tz9r") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "kube-api-access-5tz9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:21:40.531955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.531884    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-cacerts" (OuterVolumeSpecName: "cacerts") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:21:40.532073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.531992    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:21:40.532567 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.532546    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-token" (OuterVolumeSpecName: "istio-token") pod "75eb7e8a-9b9b-4de6-8c90-e0f028371521" (UID: "75eb7e8a-9b9b-4de6-8c90-e0f028371521"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:21:40.606291 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.606257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:40.630331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630308    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-token\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.630331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630328    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-kubeconfig\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.630445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630337    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75eb7e8a-9b9b-4de6-8c90-e0f028371521-local-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.630445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630346    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-dns-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.630445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630355    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tz9r\" (UniqueName: \"kubernetes.io/projected/75eb7e8a-9b9b-4de6-8c90-e0f028371521-kube-api-access-5tz9r\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.630445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630364    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75eb7e8a-9b9b-4de6-8c90-e0f028371521-istio-csr-ca-configmap\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.630445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.630373    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75eb7e8a-9b9b-4de6-8c90-e0f028371521-cacerts\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:40.776319 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.776286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:40.967950 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.967919    2564 generic.go:356] "Generic (PLEG): container finished" podID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" containerID="858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9" exitCode=0
Sep 18 13:21:40.968385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.967973    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"
Sep 18 13:21:40.968385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.968013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" event={"ID":"75eb7e8a-9b9b-4de6-8c90-e0f028371521","Type":"ContainerDied","Data":"858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9"}
Sep 18 13:21:40.968385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.968067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh" event={"ID":"75eb7e8a-9b9b-4de6-8c90-e0f028371521","Type":"ContainerDied","Data":"4c5cc257a2e5d2d8217e3fd0fd9fa06e75f41704d756816417b18fb0f38027cd"}
Sep 18 13:21:40.968385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.968098    2564 scope.go:117] "RemoveContainer" containerID="858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9"
Sep 18 13:21:40.969726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.969697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6" event={"ID":"910ba23e-5954-489f-8450-62963ac09a20","Type":"ContainerStarted","Data":"8a7c9b6ad9a8b003d48e826fdde583a02ac1eef99fb511d744fc474837b9c77e"}
Sep 18 13:21:40.977969 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.977951    2564 scope.go:117] "RemoveContainer" containerID="858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9"
Sep 18 13:21:40.978454 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:21:40.978321    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9\": container with ID starting with 858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9 not found: ID does not exist" containerID="858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9"
Sep 18 13:21:40.978454 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.978355    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9"} err="failed to get container status \"858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9\": rpc error: code = NotFound desc = could not find container \"858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9\": container with ID starting with 858d814669869aac65eac54987ffa0b142d56fc1aabe2980457d6f9a71c4e8a9 not found: ID does not exist"
Sep 18 13:21:40.998292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:40.998272    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"]
Sep 18 13:21:41.001966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:41.001949    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh"]
Sep 18 13:21:41.214498 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:41.214429    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" path="/var/lib/kubelet/pods/75eb7e8a-9b9b-4de6-8c90-e0f028371521/volumes"
Sep 18 13:21:42.982824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:42.982788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6" event={"ID":"910ba23e-5954-489f-8450-62963ac09a20","Type":"ContainerStarted","Data":"898c983ae053c0f40470239d1214220e6a5a6018297d758edc8a047a0a3be859"}
Sep 18 13:21:42.983285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:42.982926    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:21:43.082120 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:43.082068    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6" podStartSLOduration=3.02001985 podStartE2EDuration="5.082050371s" totalImagesPullingTime="2.062030521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:21:43.057564277 +0000 UTC m=+420.426823669" watchObservedRunningTime="2026-09-18 13:21:43.082050371 +0000 UTC m=+420.451309753"
Sep 18 13:21:45.639465 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:45.639415    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:45.740298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:45.740270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:46.431562 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:46.431539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:47.962535 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:47.962475    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5556f5bf6f-dvvxj" podUID="771b1d5a-29eb-4de1-826b-133925853ed3" containerName="console" containerID="cri-o://2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887" gracePeriod=15
Sep 18 13:21:48.122798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.122766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:48.199247 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.199188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:21:48.201894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.201876    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:21:48.293919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.293897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-console-config\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.293939    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt4q8\" (UniqueName: \"kubernetes.io/projected/771b1d5a-29eb-4de1-826b-133925853ed3-kube-api-access-xt4q8\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.293960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-serving-cert\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.293994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-oauth-config\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294133 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294046    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-service-ca\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294252 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-oauth-serving-cert\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294283    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-console-config" (OuterVolumeSpecName: "console-config") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:21:48.294331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-trusted-ca-bundle\") pod \"771b1d5a-29eb-4de1-826b-133925853ed3\" (UID: \"771b1d5a-29eb-4de1-826b-133925853ed3\") "
Sep 18 13:21:48.294566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294482    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-service-ca" (OuterVolumeSpecName: "service-ca") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:21:48.294666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294581    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:21:48.294724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294679    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:21:48.294779 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294740    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:48.294779 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294763    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-oauth-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:48.294855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294777    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-trusted-ca-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:48.294855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.294792    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/771b1d5a-29eb-4de1-826b-133925853ed3-console-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:48.296059 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.296040    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/771b1d5a-29eb-4de1-826b-133925853ed3-kube-api-access-xt4q8" (OuterVolumeSpecName: "kube-api-access-xt4q8") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "kube-api-access-xt4q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:21:48.296501 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.296484    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:21:48.296547 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.296509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "771b1d5a-29eb-4de1-826b-133925853ed3" (UID: "771b1d5a-29eb-4de1-826b-133925853ed3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:21:48.395093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.395065    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt4q8\" (UniqueName: \"kubernetes.io/projected/771b1d5a-29eb-4de1-826b-133925853ed3-kube-api-access-xt4q8\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:48.395093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.395091    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-serving-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:48.395093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:48.395101    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/771b1d5a-29eb-4de1-826b-133925853ed3-console-oauth-config\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:21:49.011073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.011046    2564 generic.go:356] "Generic (PLEG): container finished" podID="771b1d5a-29eb-4de1-826b-133925853ed3" containerID="2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887" exitCode=0
Sep 18 13:21:49.011393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.011083    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5556f5bf6f-dvvxj"
Sep 18 13:21:49.011393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.011118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556f5bf6f-dvvxj" event={"ID":"771b1d5a-29eb-4de1-826b-133925853ed3","Type":"ContainerDied","Data":"2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887"}
Sep 18 13:21:49.011393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.011157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5556f5bf6f-dvvxj" event={"ID":"771b1d5a-29eb-4de1-826b-133925853ed3","Type":"ContainerDied","Data":"8f28df77595cee7505b8481dc83f10ec0dca0071effb49cacd29281b7515cc85"}
Sep 18 13:21:49.011393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.011178    2564 scope.go:117] "RemoveContainer" containerID="2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887"
Sep 18 13:21:49.019276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.019256    2564 scope.go:117] "RemoveContainer" containerID="2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887"
Sep 18 13:21:49.019538 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:21:49.019516    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887\": container with ID starting with 2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887 not found: ID does not exist" containerID="2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887"
Sep 18 13:21:49.019586 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.019546    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887"} err="failed to get container status \"2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887\": rpc error: code = NotFound desc = could not find container \"2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887\": container with ID starting with 2dbd993ef6d7a03e5a89670972b61f3aa91427847b97164f1543628e9f467887 not found: ID does not exist"
Sep 18 13:21:49.049963 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.049941    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5556f5bf6f-dvvxj"]
Sep 18 13:21:49.081961 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.081937    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5556f5bf6f-dvvxj"]
Sep 18 13:21:49.214877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:21:49.214853    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="771b1d5a-29eb-4de1-826b-133925853ed3" path="/var/lib/kubelet/pods/771b1d5a-29eb-4de1-826b-133925853ed3/volumes"
Sep 18 13:22:13.992652 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:13.992590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4fdz6"
Sep 18 13:22:23.005809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:23.005770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:23.071683 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:23.071657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:29.252151 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:29.252102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:29.429101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:29.429066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:37.182292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182258    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"]
Sep 18 13:22:37.182632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182562    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771b1d5a-29eb-4de1-826b-133925853ed3" containerName="console"
Sep 18 13:22:37.182632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182573    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="771b1d5a-29eb-4de1-826b-133925853ed3" containerName="console"
Sep 18 13:22:37.182632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182591    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" containerName="discovery"
Sep 18 13:22:37.182632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182596    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" containerName="discovery"
Sep 18 13:22:37.182758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182652    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="75eb7e8a-9b9b-4de6-8c90-e0f028371521" containerName="discovery"
Sep 18 13:22:37.182758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.182663    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="771b1d5a-29eb-4de1-826b-133925853ed3" containerName="console"
Sep 18 13:22:37.185647 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.185632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.188887 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.188867    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 13:22:37.189180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.189161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 13:22:37.189983 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.189966    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tkn46\""
Sep 18 13:22:37.205832 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.205806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"]
Sep 18 13:22:37.229542 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.229516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.229640 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.229561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9q9w\" (UniqueName: \"kubernetes.io/projected/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-kube-api-access-z9q9w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.229640 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.229588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.280957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.280933    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"]
Sep 18 13:22:37.284316 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.284302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.297510 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.297486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"]
Sep 18 13:22:37.330397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.330496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.330496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.330614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.330614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfsp\" (UniqueName: \"kubernetes.io/projected/b241176a-c624-4ad3-b557-8ca3bf587898-kube-api-access-nzfsp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.330614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9q9w\" (UniqueName: \"kubernetes.io/projected/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-kube-api-access-z9q9w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.330786 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.330853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.330787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.339652 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.339634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9q9w\" (UniqueName: \"kubernetes.io/projected/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-kube-api-access-z9q9w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.364439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.364416    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"]
Sep 18 13:22:37.367800 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.367786    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.381586 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.381561    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"]
Sep 18 13:22:37.431841 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.431817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rbl\" (UniqueName: \"kubernetes.io/projected/aeb785e7-683a-410d-918f-ae896877d8ea-kube-api-access-c9rbl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.431933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.431851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.431933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.431886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.432014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.431945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.432014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.431982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.432014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.431998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfsp\" (UniqueName: \"kubernetes.io/projected/b241176a-c624-4ad3-b557-8ca3bf587898-kube-api-access-nzfsp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.432413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.432373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.432413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.432387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.442529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.442505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfsp\" (UniqueName: \"kubernetes.io/projected/b241176a-c624-4ad3-b557-8ca3bf587898-kube-api-access-nzfsp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.476574 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.476553    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"]
Sep 18 13:22:37.479916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.479903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.494251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.494228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"]
Sep 18 13:22:37.494377 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.494254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:37.533276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.533426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.533426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.533555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.533555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8ps5\" (UniqueName: \"kubernetes.io/projected/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-kube-api-access-r8ps5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.533555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rbl\" (UniqueName: \"kubernetes.io/projected/aeb785e7-683a-410d-918f-ae896877d8ea-kube-api-access-c9rbl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.533713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.533713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.533692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.544051 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.544027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rbl\" (UniqueName: \"kubernetes.io/projected/aeb785e7-683a-410d-918f-ae896877d8ea-kube-api-access-c9rbl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.592365 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.592341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:37.634580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.634550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.634719 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.634594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8ps5\" (UniqueName: \"kubernetes.io/projected/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-kube-api-access-r8ps5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.634894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.634790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.634973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.634956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.635170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.635152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.644341 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.644319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8ps5\" (UniqueName: \"kubernetes.io/projected/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-kube-api-access-r8ps5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.676091 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.676072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:37.767792 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.767763    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"]
Sep 18 13:22:37.770610 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:37.770576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9c49f0_7845_4a97_bdd3_c3d42fa0ca60.slice/crio-b51f147cdaee7b9dd215c153b69602deae25ad3807cacdeb334f890b1b2bca38 WatchSource:0}: Error finding container b51f147cdaee7b9dd215c153b69602deae25ad3807cacdeb334f890b1b2bca38: Status 404 returned error can't find the container with id b51f147cdaee7b9dd215c153b69602deae25ad3807cacdeb334f890b1b2bca38
Sep 18 13:22:37.787984 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.787967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:37.870925 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.870824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"]
Sep 18 13:22:37.873286 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:37.873259    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb241176a_c624_4ad3_b557_8ca3bf587898.slice/crio-872a54c14a0e4f15db7a10e7c6ac92066294f5f5bc6ded7b2b3b4f8c7879ef8b WatchSource:0}: Error finding container 872a54c14a0e4f15db7a10e7c6ac92066294f5f5bc6ded7b2b3b4f8c7879ef8b: Status 404 returned error can't find the container with id 872a54c14a0e4f15db7a10e7c6ac92066294f5f5bc6ded7b2b3b4f8c7879ef8b
Sep 18 13:22:37.952942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:37.952920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"]
Sep 18 13:22:37.955403 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:37.955343    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb785e7_683a_410d_918f_ae896877d8ea.slice/crio-5fb2df1ad424c26ae80ddbf3404fe5bb9068c0bd4533c727fa26564e0a637331 WatchSource:0}: Error finding container 5fb2df1ad424c26ae80ddbf3404fe5bb9068c0bd4533c727fa26564e0a637331: Status 404 returned error can't find the container with id 5fb2df1ad424c26ae80ddbf3404fe5bb9068c0bd4533c727fa26564e0a637331
Sep 18 13:22:38.089851 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.089831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"]
Sep 18 13:22:38.106906 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:38.106882    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dbe951_f7ef_4adb_ba0f_9c13cbec4d01.slice/crio-dcd3957f73cb6a3fd3877fe2ed60d83e9460252fc91d34921a644cb0edb7b145 WatchSource:0}: Error finding container dcd3957f73cb6a3fd3877fe2ed60d83e9460252fc91d34921a644cb0edb7b145: Status 404 returned error can't find the container with id dcd3957f73cb6a3fd3877fe2ed60d83e9460252fc91d34921a644cb0edb7b145
Sep 18 13:22:38.230066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.230041    2564 generic.go:356] "Generic (PLEG): container finished" podID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerID="3591c37874098f02579599999cf39970da4843237cf699be774db9e9929975a9" exitCode=0
Sep 18 13:22:38.230415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.230125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f" event={"ID":"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01","Type":"ContainerDied","Data":"3591c37874098f02579599999cf39970da4843237cf699be774db9e9929975a9"}
Sep 18 13:22:38.230415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.230178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f" event={"ID":"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01","Type":"ContainerStarted","Data":"dcd3957f73cb6a3fd3877fe2ed60d83e9460252fc91d34921a644cb0edb7b145"}
Sep 18 13:22:38.231817 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.231794    2564 generic.go:356] "Generic (PLEG): container finished" podID="aeb785e7-683a-410d-918f-ae896877d8ea" containerID="870d4d92bcac3ef6ef3e3c17986f1c8cdcd154355e1baa23659c4cd2afbc6fb6" exitCode=0
Sep 18 13:22:38.231924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.231874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7" event={"ID":"aeb785e7-683a-410d-918f-ae896877d8ea","Type":"ContainerDied","Data":"870d4d92bcac3ef6ef3e3c17986f1c8cdcd154355e1baa23659c4cd2afbc6fb6"}
Sep 18 13:22:38.231924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.231919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7" event={"ID":"aeb785e7-683a-410d-918f-ae896877d8ea","Type":"ContainerStarted","Data":"5fb2df1ad424c26ae80ddbf3404fe5bb9068c0bd4533c727fa26564e0a637331"}
Sep 18 13:22:38.233578 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.233506    2564 generic.go:356] "Generic (PLEG): container finished" podID="b241176a-c624-4ad3-b557-8ca3bf587898" containerID="b5f7a34a858f8bcc702cd96665ab802bc866959719cf447f3478684201af074d" exitCode=0
Sep 18 13:22:38.233578 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.233570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf" event={"ID":"b241176a-c624-4ad3-b557-8ca3bf587898","Type":"ContainerDied","Data":"b5f7a34a858f8bcc702cd96665ab802bc866959719cf447f3478684201af074d"}
Sep 18 13:22:38.233720 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.233598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf" event={"ID":"b241176a-c624-4ad3-b557-8ca3bf587898","Type":"ContainerStarted","Data":"872a54c14a0e4f15db7a10e7c6ac92066294f5f5bc6ded7b2b3b4f8c7879ef8b"}
Sep 18 13:22:38.235376 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.235345    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerID="af56676cd229641d6681ca02cca543e325e4e2dcb7d232b8eb7640c1e5ff5de4" exitCode=0
Sep 18 13:22:38.235446 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.235376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp" event={"ID":"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60","Type":"ContainerDied","Data":"af56676cd229641d6681ca02cca543e325e4e2dcb7d232b8eb7640c1e5ff5de4"}
Sep 18 13:22:38.235446 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:38.235415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp" event={"ID":"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60","Type":"ContainerStarted","Data":"b51f147cdaee7b9dd215c153b69602deae25ad3807cacdeb334f890b1b2bca38"}
Sep 18 13:22:40.247516 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.247485    2564 generic.go:356] "Generic (PLEG): container finished" podID="aeb785e7-683a-410d-918f-ae896877d8ea" containerID="28f535ecad2c40091027006f570c03714b861f645be79bf91542494634d224a1" exitCode=0
Sep 18 13:22:40.247925 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.247557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7" event={"ID":"aeb785e7-683a-410d-918f-ae896877d8ea","Type":"ContainerDied","Data":"28f535ecad2c40091027006f570c03714b861f645be79bf91542494634d224a1"}
Sep 18 13:22:40.249504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.249481    2564 generic.go:356] "Generic (PLEG): container finished" podID="b241176a-c624-4ad3-b557-8ca3bf587898" containerID="4ffa8a2feb0a5adcd95299d762b05ee05cf49290916b738db9f2b3be238c2a31" exitCode=0
Sep 18 13:22:40.249590 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.249549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf" event={"ID":"b241176a-c624-4ad3-b557-8ca3bf587898","Type":"ContainerDied","Data":"4ffa8a2feb0a5adcd95299d762b05ee05cf49290916b738db9f2b3be238c2a31"}
Sep 18 13:22:40.251453 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.251431    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerID="d01f2748f67a16be9cb2f92bc0ad04356563be347bcdcb73125807fab3d11444" exitCode=0
Sep 18 13:22:40.251541 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.251508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp" event={"ID":"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60","Type":"ContainerDied","Data":"d01f2748f67a16be9cb2f92bc0ad04356563be347bcdcb73125807fab3d11444"}
Sep 18 13:22:40.253413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.253392    2564 generic.go:356] "Generic (PLEG): container finished" podID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerID="9a6f3e5c718b8592d80603ec9ec049751f105dc0eaa4638c4a73820162199a66" exitCode=0
Sep 18 13:22:40.253505 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:40.253435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f" event={"ID":"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01","Type":"ContainerDied","Data":"9a6f3e5c718b8592d80603ec9ec049751f105dc0eaa4638c4a73820162199a66"}
Sep 18 13:22:41.259769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.259738    2564 generic.go:356] "Generic (PLEG): container finished" podID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerID="3157f125d7556d0e7bcc1e27507b76fa1d856418ee1ee9c3bd814a5c4f000346" exitCode=0
Sep 18 13:22:41.260121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.259797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f" event={"ID":"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01","Type":"ContainerDied","Data":"3157f125d7556d0e7bcc1e27507b76fa1d856418ee1ee9c3bd814a5c4f000346"}
Sep 18 13:22:41.261940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.261919    2564 generic.go:356] "Generic (PLEG): container finished" podID="aeb785e7-683a-410d-918f-ae896877d8ea" containerID="708a0922ab965114c7183720a0390599b58f813abf4261e069bc6a7b73c89dc4" exitCode=0
Sep 18 13:22:41.262033 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.261995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7" event={"ID":"aeb785e7-683a-410d-918f-ae896877d8ea","Type":"ContainerDied","Data":"708a0922ab965114c7183720a0390599b58f813abf4261e069bc6a7b73c89dc4"}
Sep 18 13:22:41.263957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.263939    2564 generic.go:356] "Generic (PLEG): container finished" podID="b241176a-c624-4ad3-b557-8ca3bf587898" containerID="7c0d33e8ab30b7a2f40c61d451b66cb0a4e4f17708e05c1c507c3e709dddc5ca" exitCode=0
Sep 18 13:22:41.264062 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.264007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf" event={"ID":"b241176a-c624-4ad3-b557-8ca3bf587898","Type":"ContainerDied","Data":"7c0d33e8ab30b7a2f40c61d451b66cb0a4e4f17708e05c1c507c3e709dddc5ca"}
Sep 18 13:22:41.271658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.271636    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerID="4389749aa074098dd61bbabfe9118de15ddef98ca98baf5d67441a260abb6afc" exitCode=0
Sep 18 13:22:41.271743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:41.271674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp" event={"ID":"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60","Type":"ContainerDied","Data":"4389749aa074098dd61bbabfe9118de15ddef98ca98baf5d67441a260abb6afc"}
Sep 18 13:22:42.428455 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.428434    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:42.450158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.450128    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:42.453951 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.453930    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:42.471909 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.471883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-util\") pod \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") "
Sep 18 13:22:42.472018 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.471960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9q9w\" (UniqueName: \"kubernetes.io/projected/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-kube-api-access-z9q9w\") pod \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") "
Sep 18 13:22:42.472076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.472035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-bundle\") pod \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\" (UID: \"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60\") "
Sep 18 13:22:42.472542 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.472514    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-bundle" (OuterVolumeSpecName: "bundle") pod "2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" (UID: "2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.473325 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.473305    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:42.474318 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.474294    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-kube-api-access-z9q9w" (OuterVolumeSpecName: "kube-api-access-z9q9w") pod "2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" (UID: "2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60"). InnerVolumeSpecName "kube-api-access-z9q9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:22:42.478144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.478123    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-util" (OuterVolumeSpecName: "util") pod "2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" (UID: "2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.572831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572779    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzfsp\" (UniqueName: \"kubernetes.io/projected/b241176a-c624-4ad3-b557-8ca3bf587898-kube-api-access-nzfsp\") pod \"b241176a-c624-4ad3-b557-8ca3bf587898\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") "
Sep 18 13:22:42.572831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572808    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-util\") pod \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") "
Sep 18 13:22:42.572831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-util\") pod \"b241176a-c624-4ad3-b557-8ca3bf587898\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") "
Sep 18 13:22:42.573025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-util\") pod \"aeb785e7-683a-410d-918f-ae896877d8ea\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") "
Sep 18 13:22:42.573025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572899    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9rbl\" (UniqueName: \"kubernetes.io/projected/aeb785e7-683a-410d-918f-ae896877d8ea-kube-api-access-c9rbl\") pod \"aeb785e7-683a-410d-918f-ae896877d8ea\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") "
Sep 18 13:22:42.573025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8ps5\" (UniqueName: \"kubernetes.io/projected/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-kube-api-access-r8ps5\") pod \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") "
Sep 18 13:22:42.573025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-bundle\") pod \"b241176a-c624-4ad3-b557-8ca3bf587898\" (UID: \"b241176a-c624-4ad3-b557-8ca3bf587898\") "
Sep 18 13:22:42.573025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572968    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-bundle\") pod \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\" (UID: \"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01\") "
Sep 18 13:22:42.573025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.572992    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-bundle\") pod \"aeb785e7-683a-410d-918f-ae896877d8ea\" (UID: \"aeb785e7-683a-410d-918f-ae896877d8ea\") "
Sep 18 13:22:42.573379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.573177    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.573379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.573217    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9q9w\" (UniqueName: \"kubernetes.io/projected/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-kube-api-access-z9q9w\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.573379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.573233    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.573728 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.573704    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-bundle" (OuterVolumeSpecName: "bundle") pod "aeb785e7-683a-410d-918f-ae896877d8ea" (UID: "aeb785e7-683a-410d-918f-ae896877d8ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.574486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.574340    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-bundle" (OuterVolumeSpecName: "bundle") pod "58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" (UID: "58dbe951-f7ef-4adb-ba0f-9c13cbec4d01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.574486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.574447    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-bundle" (OuterVolumeSpecName: "bundle") pod "b241176a-c624-4ad3-b557-8ca3bf587898" (UID: "b241176a-c624-4ad3-b557-8ca3bf587898"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.575327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.575305    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-kube-api-access-r8ps5" (OuterVolumeSpecName: "kube-api-access-r8ps5") pod "58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" (UID: "58dbe951-f7ef-4adb-ba0f-9c13cbec4d01"). InnerVolumeSpecName "kube-api-access-r8ps5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:22:42.575424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.575333    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b241176a-c624-4ad3-b557-8ca3bf587898-kube-api-access-nzfsp" (OuterVolumeSpecName: "kube-api-access-nzfsp") pod "b241176a-c624-4ad3-b557-8ca3bf587898" (UID: "b241176a-c624-4ad3-b557-8ca3bf587898"). InnerVolumeSpecName "kube-api-access-nzfsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:22:42.575424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.575352    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb785e7-683a-410d-918f-ae896877d8ea-kube-api-access-c9rbl" (OuterVolumeSpecName: "kube-api-access-c9rbl") pod "aeb785e7-683a-410d-918f-ae896877d8ea" (UID: "aeb785e7-683a-410d-918f-ae896877d8ea"). InnerVolumeSpecName "kube-api-access-c9rbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:22:42.578722 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.578702    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-util" (OuterVolumeSpecName: "util") pod "b241176a-c624-4ad3-b557-8ca3bf587898" (UID: "b241176a-c624-4ad3-b557-8ca3bf587898"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.579288 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.579270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-util" (OuterVolumeSpecName: "util") pod "aeb785e7-683a-410d-918f-ae896877d8ea" (UID: "aeb785e7-683a-410d-918f-ae896877d8ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.579367 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.579348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-util" (OuterVolumeSpecName: "util") pod "58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" (UID: "58dbe951-f7ef-4adb-ba0f-9c13cbec4d01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:22:42.673893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673864    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9rbl\" (UniqueName: \"kubernetes.io/projected/aeb785e7-683a-410d-918f-ae896877d8ea-kube-api-access-c9rbl\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.673893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673893    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8ps5\" (UniqueName: \"kubernetes.io/projected/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-kube-api-access-r8ps5\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.673893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673903    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.674048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673912    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.674048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673920    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-bundle\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.674048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673928    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzfsp\" (UniqueName: \"kubernetes.io/projected/b241176a-c624-4ad3-b557-8ca3bf587898-kube-api-access-nzfsp\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.674048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673936    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58dbe951-f7ef-4adb-ba0f-9c13cbec4d01-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.674048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673945    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b241176a-c624-4ad3-b557-8ca3bf587898-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:42.674048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:42.673952    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aeb785e7-683a-410d-918f-ae896877d8ea-util\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:22:43.282642 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.282619    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7"
Sep 18 13:22:43.282730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.282617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ct6kl7" event={"ID":"aeb785e7-683a-410d-918f-ae896877d8ea","Type":"ContainerDied","Data":"5fb2df1ad424c26ae80ddbf3404fe5bb9068c0bd4533c727fa26564e0a637331"}
Sep 18 13:22:43.282777 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.282745    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fb2df1ad424c26ae80ddbf3404fe5bb9068c0bd4533c727fa26564e0a637331"
Sep 18 13:22:43.284793 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.284751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf" event={"ID":"b241176a-c624-4ad3-b557-8ca3bf587898","Type":"ContainerDied","Data":"872a54c14a0e4f15db7a10e7c6ac92066294f5f5bc6ded7b2b3b4f8c7879ef8b"}
Sep 18 13:22:43.284889 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.284802    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="872a54c14a0e4f15db7a10e7c6ac92066294f5f5bc6ded7b2b3b4f8c7879ef8b"
Sep 18 13:22:43.284889 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.284882    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asnqpf"
Sep 18 13:22:43.286845 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.286830    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp"
Sep 18 13:22:43.286926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.286859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6pmlsp" event={"ID":"2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60","Type":"ContainerDied","Data":"b51f147cdaee7b9dd215c153b69602deae25ad3807cacdeb334f890b1b2bca38"}
Sep 18 13:22:43.286926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.286894    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b51f147cdaee7b9dd215c153b69602deae25ad3807cacdeb334f890b1b2bca38"
Sep 18 13:22:43.288924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.288908    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f"
Sep 18 13:22:43.289011 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.288934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7csl9f" event={"ID":"58dbe951-f7ef-4adb-ba0f-9c13cbec4d01","Type":"ContainerDied","Data":"dcd3957f73cb6a3fd3877fe2ed60d83e9460252fc91d34921a644cb0edb7b145"}
Sep 18 13:22:43.289011 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:43.288989    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcd3957f73cb6a3fd3877fe2ed60d83e9460252fc91d34921a644cb0edb7b145"
Sep 18 13:22:48.021481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:48.021442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:50.312524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312488    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"]
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312783    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="util"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312795    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="util"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312803    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="util"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312809    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="util"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312816    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="extract"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312822    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="extract"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312829    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="pull"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312834    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="pull"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312841    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="extract"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312846    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="extract"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312853    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="pull"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312858    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="pull"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312868    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="util"
Sep 18 13:22:50.312870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312873    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="util"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312882    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="pull"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312887    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="pull"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312911    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312916    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312924    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="pull"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312929    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="pull"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312938    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="util"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312943    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="util"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312949    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312954    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.312998    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeb785e7-683a-410d-918f-ae896877d8ea" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.313007    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c9c49f0-7845-4a97-bdd3-c3d42fa0ca60" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.313014    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58dbe951-f7ef-4adb-ba0f-9c13cbec4d01" containerName="extract"
Sep 18 13:22:50.313312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.313021    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b241176a-c624-4ad3-b557-8ca3bf587898" containerName="extract"
Sep 18 13:22:50.317485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.317469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:22:50.323968 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.323948    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nrlvv\""
Sep 18 13:22:50.325090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.325064    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 13:22:50.325180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.325091    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 13:22:50.347840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.347815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"]
Sep 18 13:22:50.423742 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.423713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f28rb\" (UniqueName: \"kubernetes.io/projected/3b48a8b4-c199-42b7-b159-8d212dd27ed2-kube-api-access-f28rb\") pod \"limitador-operator-controller-manager-74495c69f8-f6kbb\" (UID: \"3b48a8b4-c199-42b7-b159-8d212dd27ed2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:22:50.524827 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.524804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f28rb\" (UniqueName: \"kubernetes.io/projected/3b48a8b4-c199-42b7-b159-8d212dd27ed2-kube-api-access-f28rb\") pod \"limitador-operator-controller-manager-74495c69f8-f6kbb\" (UID: \"3b48a8b4-c199-42b7-b159-8d212dd27ed2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:22:50.564867 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.564816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f28rb\" (UniqueName: \"kubernetes.io/projected/3b48a8b4-c199-42b7-b159-8d212dd27ed2-kube-api-access-f28rb\") pod \"limitador-operator-controller-manager-74495c69f8-f6kbb\" (UID: \"3b48a8b4-c199-42b7-b159-8d212dd27ed2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:22:50.627889 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.627870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:22:50.944484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:50.944417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"]
Sep 18 13:22:50.952060 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:50.952033    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b48a8b4_c199_42b7_b159_8d212dd27ed2.slice/crio-889fae353fdcd6928a61b1dc2afa40deaff830da54e971be0126f41df0cc5f3f WatchSource:0}: Error finding container 889fae353fdcd6928a61b1dc2afa40deaff830da54e971be0126f41df0cc5f3f: Status 404 returned error can't find the container with id 889fae353fdcd6928a61b1dc2afa40deaff830da54e971be0126f41df0cc5f3f
Sep 18 13:22:51.210183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:51.210092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:51.327987 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:51.327956    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb" event={"ID":"3b48a8b4-c199-42b7-b159-8d212dd27ed2","Type":"ContainerStarted","Data":"889fae353fdcd6928a61b1dc2afa40deaff830da54e971be0126f41df0cc5f3f"}
Sep 18 13:22:51.652960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:51.652930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:51.980616 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:51.980492    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:53.326042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:53.326005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:54.244134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:54.244101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:54.348174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:54.348144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb" event={"ID":"3b48a8b4-c199-42b7-b159-8d212dd27ed2","Type":"ContainerStarted","Data":"0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf"}
Sep 18 13:22:54.348540 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:54.348228    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:22:54.375062 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:54.375036    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:54.383384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:54.383346    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb" podStartSLOduration=1.7341020089999999 podStartE2EDuration="4.383333099s" totalImagesPullingTime="2.64923109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:22:54.382390433 +0000 UTC m=+491.751649815" watchObservedRunningTime="2026-09-18 13:22:54.383333099 +0000 UTC m=+491.752592480"
Sep 18 13:22:55.118772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.118738    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"]
Sep 18 13:22:55.122189 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.122168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.125743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.125723    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sbkdk\""
Sep 18 13:22:55.179404 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.179377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"]
Sep 18 13:22:55.266787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.266762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prv4s\" (UniqueName: \"kubernetes.io/projected/86dcece4-1cf3-46e9-97b7-831013003ae4-kube-api-access-prv4s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.266906 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.266817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86dcece4-1cf3-46e9-97b7-831013003ae4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.368139 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.368113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prv4s\" (UniqueName: \"kubernetes.io/projected/86dcece4-1cf3-46e9-97b7-831013003ae4-kube-api-access-prv4s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.368448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.368176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86dcece4-1cf3-46e9-97b7-831013003ae4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.368526 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.368509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86dcece4-1cf3-46e9-97b7-831013003ae4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.382878 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.382822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prv4s\" (UniqueName: \"kubernetes.io/projected/86dcece4-1cf3-46e9-97b7-831013003ae4-kube-api-access-prv4s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.431892 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.431868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:22:55.641805 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.641719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:55.715376 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:55.715346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"]
Sep 18 13:22:55.717997 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:55.717963    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dcece4_1cf3_46e9_97b7_831013003ae4.slice/crio-46346b74cea736bc31a35ded3b51b6faf6a34ed87ec5819289de04075e18d8d0 WatchSource:0}: Error finding container 46346b74cea736bc31a35ded3b51b6faf6a34ed87ec5819289de04075e18d8d0: Status 404 returned error can't find the container with id 46346b74cea736bc31a35ded3b51b6faf6a34ed87ec5819289de04075e18d8d0
Sep 18 13:22:56.359104 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:56.359072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm" event={"ID":"86dcece4-1cf3-46e9-97b7-831013003ae4","Type":"ContainerStarted","Data":"46346b74cea736bc31a35ded3b51b6faf6a34ed87ec5819289de04075e18d8d0"}
Sep 18 13:22:56.598748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:56.598717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:57.196189 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.196157    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"]
Sep 18 13:22:57.199532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.199509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:22:57.202280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.202260    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 18 13:22:57.202399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.202331    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cnpt4\""
Sep 18 13:22:57.217550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.217508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"]
Sep 18 13:22:57.282090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.282069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtfs\" (UniqueName: \"kubernetes.io/projected/ccc18df3-4777-4fbc-b634-01c256c0f7aa-kube-api-access-vjtfs\") pod \"dns-operator-controller-manager-7b84cd7c9c-ntqpd\" (UID: \"ccc18df3-4777-4fbc-b634-01c256c0f7aa\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:22:57.382395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.382371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtfs\" (UniqueName: \"kubernetes.io/projected/ccc18df3-4777-4fbc-b634-01c256c0f7aa-kube-api-access-vjtfs\") pod \"dns-operator-controller-manager-7b84cd7c9c-ntqpd\" (UID: \"ccc18df3-4777-4fbc-b634-01c256c0f7aa\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:22:57.397378 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.397353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtfs\" (UniqueName: \"kubernetes.io/projected/ccc18df3-4777-4fbc-b634-01c256c0f7aa-kube-api-access-vjtfs\") pod \"dns-operator-controller-manager-7b84cd7c9c-ntqpd\" (UID: \"ccc18df3-4777-4fbc-b634-01c256c0f7aa\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:22:57.511283 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.511262    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:22:57.535857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.535827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:57.818984 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:57.818911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"]
Sep 18 13:22:57.821097 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:22:57.821068    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc18df3_4777_4fbc_b634_01c256c0f7aa.slice/crio-6482ef24cd1dc7b7fd19cc6200b114f4256e65719ed7f0fbaa92334ff0a8c2a6 WatchSource:0}: Error finding container 6482ef24cd1dc7b7fd19cc6200b114f4256e65719ed7f0fbaa92334ff0a8c2a6: Status 404 returned error can't find the container with id 6482ef24cd1dc7b7fd19cc6200b114f4256e65719ed7f0fbaa92334ff0a8c2a6
Sep 18 13:22:58.051951 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:58.051917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:58.370613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:58.370573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd" event={"ID":"ccc18df3-4777-4fbc-b634-01c256c0f7aa","Type":"ContainerStarted","Data":"6482ef24cd1dc7b7fd19cc6200b114f4256e65719ed7f0fbaa92334ff0a8c2a6"}
Sep 18 13:22:58.937986 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:58.937954    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:22:59.164449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:22:59.164401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:00.387584 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.387498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd" event={"ID":"ccc18df3-4777-4fbc-b634-01c256c0f7aa","Type":"ContainerStarted","Data":"838c32f1326ead86448f4ddf1e74dde85df43c2dd80bc55a09256a0651f27c66"}
Sep 18 13:23:00.387908 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.387646    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:23:00.393502 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.393473    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-w6btw"]
Sep 18 13:23:00.397473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.397453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:00.402284 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.402266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lzwf6\""
Sep 18 13:23:00.413738 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.413714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-w6btw"]
Sep 18 13:23:00.506068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.506012    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd" podStartSLOduration=1.291540233 podStartE2EDuration="3.505992818s" totalImagesPullingTime="2.214452585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:00.437300445 +0000 UTC m=+497.806559826" watchObservedRunningTime="2026-09-18 13:23:00.505992818 +0000 UTC m=+497.875252202"
Sep 18 13:23:00.509912 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.509878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45h7v\" (UniqueName: \"kubernetes.io/projected/c74235a6-98f7-44f8-8f8d-05e0e8aa41e0-kube-api-access-45h7v\") pod \"authorino-operator-76b478bd78-w6btw\" (UID: \"c74235a6-98f7-44f8-8f8d-05e0e8aa41e0\") " pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:00.611137 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.611111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45h7v\" (UniqueName: \"kubernetes.io/projected/c74235a6-98f7-44f8-8f8d-05e0e8aa41e0-kube-api-access-45h7v\") pod \"authorino-operator-76b478bd78-w6btw\" (UID: \"c74235a6-98f7-44f8-8f8d-05e0e8aa41e0\") " pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:00.621640 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.621615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45h7v\" (UniqueName: \"kubernetes.io/projected/c74235a6-98f7-44f8-8f8d-05e0e8aa41e0-kube-api-access-45h7v\") pod \"authorino-operator-76b478bd78-w6btw\" (UID: \"c74235a6-98f7-44f8-8f8d-05e0e8aa41e0\") " pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:00.710500 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:00.710441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:01.577879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:01.577811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:01.703069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:01.703037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:01.903693 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:01.903630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-w6btw"]
Sep 18 13:23:01.907277 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:23:01.907250    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74235a6_98f7_44f8_8f8d_05e0e8aa41e0.slice/crio-a8664e3d5ee90d23956c54b443d02f3ceda21713381267707a48e9b68cbe5dcd WatchSource:0}: Error finding container a8664e3d5ee90d23956c54b443d02f3ceda21713381267707a48e9b68cbe5dcd: Status 404 returned error can't find the container with id a8664e3d5ee90d23956c54b443d02f3ceda21713381267707a48e9b68cbe5dcd
Sep 18 13:23:02.401354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:02.401315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm" event={"ID":"86dcece4-1cf3-46e9-97b7-831013003ae4","Type":"ContainerStarted","Data":"d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac"}
Sep 18 13:23:02.401538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:02.401378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:02.402631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:02.402611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw" event={"ID":"c74235a6-98f7-44f8-8f8d-05e0e8aa41e0","Type":"ContainerStarted","Data":"a8664e3d5ee90d23956c54b443d02f3ceda21713381267707a48e9b68cbe5dcd"}
Sep 18 13:23:02.454390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:02.454347    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm" podStartSLOduration=1.4832469750000001 podStartE2EDuration="7.45433413s" totalImagesPullingTime="5.971087155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:02.452995565 +0000 UTC m=+499.822254948" watchObservedRunningTime="2026-09-18 13:23:02.45433413 +0000 UTC m=+499.823593512"
Sep 18 13:23:04.422490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:04.422458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw" event={"ID":"c74235a6-98f7-44f8-8f8d-05e0e8aa41e0","Type":"ContainerStarted","Data":"443c4122a9cbb05120e805e6ffce4a59f9fbb92af19a4aeac7f70cfb910c7a97"}
Sep 18 13:23:04.422873 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:04.422590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:05.019708 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.019666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:05.102855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.102803    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw" podStartSLOduration=3.621549119 podStartE2EDuration="5.102785183s" totalImagesPullingTime="1.481236064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:04.529540128 +0000 UTC m=+501.898799510" watchObservedRunningTime="2026-09-18 13:23:05.102785183 +0000 UTC m=+502.472044566"
Sep 18 13:23:05.105050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.105020    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"]
Sep 18 13:23:05.108605 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.108587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.111891 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.111868    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 18 13:23:05.112902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.112886    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 18 13:23:05.115097 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.115079    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mvlcr\""
Sep 18 13:23:05.130292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.130272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"]
Sep 18 13:23:05.248467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.248442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9affab7e-a8ff-473d-8be4-17188e4c4b06-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.248598 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.248511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2r4m\" (UniqueName: \"kubernetes.io/projected/9affab7e-a8ff-473d-8be4-17188e4c4b06-kube-api-access-g2r4m\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.248598 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.248549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9affab7e-a8ff-473d-8be4-17188e4c4b06-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.306439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.306377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:05.349397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.349368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9affab7e-a8ff-473d-8be4-17188e4c4b06-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.349498 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.349448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2r4m\" (UniqueName: \"kubernetes.io/projected/9affab7e-a8ff-473d-8be4-17188e4c4b06-kube-api-access-g2r4m\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.349575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.349499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9affab7e-a8ff-473d-8be4-17188e4c4b06-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.350124 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.350103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9affab7e-a8ff-473d-8be4-17188e4c4b06-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.351602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.351584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9affab7e-a8ff-473d-8be4-17188e4c4b06-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.354858 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.354839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:05.361916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.361898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2r4m\" (UniqueName: \"kubernetes.io/projected/9affab7e-a8ff-473d-8be4-17188e4c4b06-kube-api-access-g2r4m\") pod \"kuadrant-console-plugin-fbdd4f445-4p5ld\" (UID: \"9affab7e-a8ff-473d-8be4-17188e4c4b06\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.417092 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.417074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"
Sep 18 13:23:05.705382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.705311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld"]
Sep 18 13:23:05.709445 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:23:05.709400    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9affab7e_a8ff_473d_8be4_17188e4c4b06.slice/crio-b1ec30ebd8a33b1948a692d59d61e703ca06983bfa7eacfb06d5b7d9806889e7 WatchSource:0}: Error finding container b1ec30ebd8a33b1948a692d59d61e703ca06983bfa7eacfb06d5b7d9806889e7: Status 404 returned error can't find the container with id b1ec30ebd8a33b1948a692d59d61e703ca06983bfa7eacfb06d5b7d9806889e7
Sep 18 13:23:05.816459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:05.816430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:06.046246 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:06.046222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:06.434640 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:06.434580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld" event={"ID":"9affab7e-a8ff-473d-8be4-17188e4c4b06","Type":"ContainerStarted","Data":"b1ec30ebd8a33b1948a692d59d61e703ca06983bfa7eacfb06d5b7d9806889e7"}
Sep 18 13:23:06.486951 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:06.486927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:07.136627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:07.136596    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:07.501777 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:07.501734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:11.396624 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:11.396603    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ntqpd"
Sep 18 13:23:11.475482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:11.475449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld" event={"ID":"9affab7e-a8ff-473d-8be4-17188e4c4b06","Type":"ContainerStarted","Data":"ee5950efc35615f72601b5b4c85dd879a0ac54cd138e9eac3b05beb9bff99bba"}
Sep 18 13:23:11.512623 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:11.512550    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4p5ld" podStartSLOduration=1.490681135 podStartE2EDuration="6.512536169s" totalImagesPullingTime="5.021855034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:11.511362249 +0000 UTC m=+508.880621642" watchObservedRunningTime="2026-09-18 13:23:11.512536169 +0000 UTC m=+508.881795551"
Sep 18 13:23:12.681971 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:12.681937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:13.187186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:13.187161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:13.418157 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:13.418131    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:14.609050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:14.609008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:15.431264 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:15.431227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-w6btw"
Sep 18 13:23:16.620833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.620804    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"]
Sep 18 13:23:16.621218 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.620988    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" containerName="manager" containerID="cri-o://d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac" gracePeriod=2
Sep 18 13:23:16.640410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.640385    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"]
Sep 18 13:23:16.642730 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.642692    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"86dcece4-1cf3-46e9-97b7-831013003ae4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-62npm\": pods \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:16.698154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.698122    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"]
Sep 18 13:23:16.698400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.698374    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" containerName="manager" containerID="cri-o://0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf" gracePeriod=2
Sep 18 13:23:16.701370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.701343    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"]
Sep 18 13:23:16.702900 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.702866    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:16.704972 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.704946    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6kbb\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:16.742369 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742346    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"]
Sep 18 13:23:16.742692 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742680    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" containerName="manager"
Sep 18 13:23:16.742730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742695    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" containerName="manager"
Sep 18 13:23:16.742730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742703    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" containerName="manager"
Sep 18 13:23:16.742730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742709    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" containerName="manager"
Sep 18 13:23:16.742830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742781    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" containerName="manager"
Sep 18 13:23:16.742830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.742790    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" containerName="manager"
Sep 18 13:23:16.745874 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.745856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.753540 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.753506    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:16.756125 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.756091    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6kbb\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:16.793937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.793905    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"]
Sep 18 13:23:16.797482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.797464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:16.843236 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.843177    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"]
Sep 18 13:23:16.844490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.844343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8549e15-15db-4e7d-a406-b1598c2685ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-frjwb\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.844490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.844409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssm2c\" (UniqueName: \"kubernetes.io/projected/f8549e15-15db-4e7d-a406-b1598c2685ba-kube-api-access-ssm2c\") pod \"kuadrant-operator-controller-manager-76f8f686bf-frjwb\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.846159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.846134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"]
Sep 18 13:23:16.868776 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.868731    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:16.883819 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.883648    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6kbb\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:16.942216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.942181    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:16.945167 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.945138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:16.945507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.945487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxk2k\" (UniqueName: \"kubernetes.io/projected/cd252470-8421-4f92-a72b-c435cbfd22dc-kube-api-access-qxk2k\") pod \"limitador-operator-controller-manager-74495c69f8-xk2gb\" (UID: \"cd252470-8421-4f92-a72b-c435cbfd22dc\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:16.945558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.945537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8549e15-15db-4e7d-a406-b1598c2685ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-frjwb\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.945655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.945581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssm2c\" (UniqueName: \"kubernetes.io/projected/f8549e15-15db-4e7d-a406-b1598c2685ba-kube-api-access-ssm2c\") pod \"kuadrant-operator-controller-manager-76f8f686bf-frjwb\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.945871 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.945853    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8549e15-15db-4e7d-a406-b1598c2685ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-frjwb\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.967353 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.967321    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-62npm\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:16.967353 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:16.967344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssm2c\" (UniqueName: \"kubernetes.io/projected/f8549e15-15db-4e7d-a406-b1598c2685ba-kube-api-access-ssm2c\") pod \"kuadrant-operator-controller-manager-76f8f686bf-frjwb\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:16.969639 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:16.969616    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-f6kbb\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:17.046086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.046066    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86dcece4-1cf3-46e9-97b7-831013003ae4-extensions-socket-volume\") pod \"86dcece4-1cf3-46e9-97b7-831013003ae4\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") "
Sep 18 13:23:17.046174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.046123    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prv4s\" (UniqueName: \"kubernetes.io/projected/86dcece4-1cf3-46e9-97b7-831013003ae4-kube-api-access-prv4s\") pod \"86dcece4-1cf3-46e9-97b7-831013003ae4\" (UID: \"86dcece4-1cf3-46e9-97b7-831013003ae4\") "
Sep 18 13:23:17.046174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.046150    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f28rb\" (UniqueName: \"kubernetes.io/projected/3b48a8b4-c199-42b7-b159-8d212dd27ed2-kube-api-access-f28rb\") pod \"3b48a8b4-c199-42b7-b159-8d212dd27ed2\" (UID: \"3b48a8b4-c199-42b7-b159-8d212dd27ed2\") "
Sep 18 13:23:17.046289 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.046255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxk2k\" (UniqueName: \"kubernetes.io/projected/cd252470-8421-4f92-a72b-c435cbfd22dc-kube-api-access-qxk2k\") pod \"limitador-operator-controller-manager-74495c69f8-xk2gb\" (UID: \"cd252470-8421-4f92-a72b-c435cbfd22dc\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:17.046547 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.046525    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86dcece4-1cf3-46e9-97b7-831013003ae4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86dcece4-1cf3-46e9-97b7-831013003ae4" (UID: "86dcece4-1cf3-46e9-97b7-831013003ae4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:23:17.048038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.048019    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86dcece4-1cf3-46e9-97b7-831013003ae4-kube-api-access-prv4s" (OuterVolumeSpecName: "kube-api-access-prv4s") pod "86dcece4-1cf3-46e9-97b7-831013003ae4" (UID: "86dcece4-1cf3-46e9-97b7-831013003ae4"). InnerVolumeSpecName "kube-api-access-prv4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:23:17.048097 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.048074    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b48a8b4-c199-42b7-b159-8d212dd27ed2-kube-api-access-f28rb" (OuterVolumeSpecName: "kube-api-access-f28rb") pod "3b48a8b4-c199-42b7-b159-8d212dd27ed2" (UID: "3b48a8b4-c199-42b7-b159-8d212dd27ed2"). InnerVolumeSpecName "kube-api-access-f28rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:23:17.062467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.062444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxk2k\" (UniqueName: \"kubernetes.io/projected/cd252470-8421-4f92-a72b-c435cbfd22dc-kube-api-access-qxk2k\") pod \"limitador-operator-controller-manager-74495c69f8-xk2gb\" (UID: \"cd252470-8421-4f92-a72b-c435cbfd22dc\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:17.069216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.069183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:17.107204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.107168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:17.147678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.147617    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86dcece4-1cf3-46e9-97b7-831013003ae4-extensions-socket-volume\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:23:17.147678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.147641    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prv4s\" (UniqueName: \"kubernetes.io/projected/86dcece4-1cf3-46e9-97b7-831013003ae4-kube-api-access-prv4s\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:23:17.147678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.147651    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f28rb\" (UniqueName: \"kubernetes.io/projected/3b48a8b4-c199-42b7-b159-8d212dd27ed2-kube-api-access-f28rb\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:23:17.214501 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.214476    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" path="/var/lib/kubelet/pods/3b48a8b4-c199-42b7-b159-8d212dd27ed2/volumes"
Sep 18 13:23:17.214818 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.214805    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86dcece4-1cf3-46e9-97b7-831013003ae4" path="/var/lib/kubelet/pods/86dcece4-1cf3-46e9-97b7-831013003ae4/volumes"
Sep 18 13:23:17.404178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.404155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"]
Sep 18 13:23:17.406602 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:23:17.406579    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8549e15_15db_4e7d_a406_b1598c2685ba.slice/crio-fab819b2846ec106d6a340049be8982cb5313650af791719d5bf9b1fb6e87767 WatchSource:0}: Error finding container fab819b2846ec106d6a340049be8982cb5313650af791719d5bf9b1fb6e87767: Status 404 returned error can't find the container with id fab819b2846ec106d6a340049be8982cb5313650af791719d5bf9b1fb6e87767
Sep 18 13:23:17.431007 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.430988    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"]
Sep 18 13:23:17.438120 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:23:17.438096    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd252470_8421_4f92_a72b_c435cbfd22dc.slice/crio-39a6e3617a05000627b42bbb3deb012685a7e75ce2ab8304c8c379f67b01908b WatchSource:0}: Error finding container 39a6e3617a05000627b42bbb3deb012685a7e75ce2ab8304c8c379f67b01908b: Status 404 returned error can't find the container with id 39a6e3617a05000627b42bbb3deb012685a7e75ce2ab8304c8c379f67b01908b
Sep 18 13:23:17.508816 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.508791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb" event={"ID":"cd252470-8421-4f92-a72b-c435cbfd22dc","Type":"ContainerStarted","Data":"39a6e3617a05000627b42bbb3deb012685a7e75ce2ab8304c8c379f67b01908b"}
Sep 18 13:23:17.510600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.510577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb" event={"ID":"f8549e15-15db-4e7d-a406-b1598c2685ba","Type":"ContainerStarted","Data":"084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c"}
Sep 18 13:23:17.510762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.510626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb" event={"ID":"f8549e15-15db-4e7d-a406-b1598c2685ba","Type":"ContainerStarted","Data":"fab819b2846ec106d6a340049be8982cb5313650af791719d5bf9b1fb6e87767"}
Sep 18 13:23:17.510762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.510656    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:17.511990 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.511961    2564 generic.go:356] "Generic (PLEG): container finished" podID="86dcece4-1cf3-46e9-97b7-831013003ae4" containerID="d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac" exitCode=0
Sep 18 13:23:17.512099 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.512004    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-62npm"
Sep 18 13:23:17.512099 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.512046    2564 scope.go:117] "RemoveContainer" containerID="d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac"
Sep 18 13:23:17.513676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.513649    2564 generic.go:356] "Generic (PLEG): container finished" podID="3b48a8b4-c199-42b7-b159-8d212dd27ed2" containerID="0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf" exitCode=0
Sep 18 13:23:17.513800 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.513679    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f6kbb"
Sep 18 13:23:17.520224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.520184    2564 scope.go:117] "RemoveContainer" containerID="d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac"
Sep 18 13:23:17.520482 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:17.520465    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac\": container with ID starting with d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac not found: ID does not exist" containerID="d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac"
Sep 18 13:23:17.520543 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.520490    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac"} err="failed to get container status \"d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac\": rpc error: code = NotFound desc = could not find container \"d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac\": container with ID starting with d9ca6e900ff6eca95c9a5f8fa3d7fb2f041d9cde4010a36204c2aed5a31be4ac not found: ID does not exist"
Sep 18 13:23:17.520543 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.520505    2564 scope.go:117] "RemoveContainer" containerID="0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf"
Sep 18 13:23:17.527886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.527869    2564 scope.go:117] "RemoveContainer" containerID="0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf"
Sep 18 13:23:17.528143 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:17.528126    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf\": container with ID starting with 0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf not found: ID does not exist" containerID="0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf"
Sep 18 13:23:17.528225 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.528148    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf"} err="failed to get container status \"0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf\": rpc error: code = NotFound desc = could not find container \"0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf\": container with ID starting with 0e1747654155d7115ca26095557c14561b28a5f614ea626017a55246d8b406bf not found: ID does not exist"
Sep 18 13:23:17.565481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:17.565437    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb" podStartSLOduration=1.56542445 podStartE2EDuration="1.56542445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:17.559295643 +0000 UTC m=+514.928555024" watchObservedRunningTime="2026-09-18 13:23:17.56542445 +0000 UTC m=+514.934683832"
Sep 18 13:23:18.521590 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:18.521552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb" event={"ID":"cd252470-8421-4f92-a72b-c435cbfd22dc","Type":"ContainerStarted","Data":"1110d87dd80e4c3a732a93f4b3c2fa90fad0dd74cb1f28d131e5aaf7e4606c95"}
Sep 18 13:23:18.521980 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:18.521694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:18.556658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:18.556617    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb" podStartSLOduration=2.556601573 podStartE2EDuration="2.556601573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:18.555324352 +0000 UTC m=+515.924583734" watchObservedRunningTime="2026-09-18 13:23:18.556601573 +0000 UTC m=+515.925860955"
Sep 18 13:23:19.008958 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:19.008925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:19.176499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:19.176473    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:21.978462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:21.978399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:22.283176 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:22.283143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:25.324483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:25.324449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:25.462271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:25.462240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:25.594682 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:25.594614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:25.690468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:25.690440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:28.524411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:28.524384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:29.530301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:29.530275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xk2gb"
Sep 18 13:23:31.942600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:31.942542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:32.139741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:32.139718    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:37.000563 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.000492    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"]
Sep 18 13:23:37.000926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.000693    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb" podUID="f8549e15-15db-4e7d-a406-b1598c2685ba" containerName="manager" containerID="cri-o://084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c" gracePeriod=10
Sep 18 13:23:37.240802 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.240779    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:37.292177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.292106    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssm2c\" (UniqueName: \"kubernetes.io/projected/f8549e15-15db-4e7d-a406-b1598c2685ba-kube-api-access-ssm2c\") pod \"f8549e15-15db-4e7d-a406-b1598c2685ba\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") "
Sep 18 13:23:37.292177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.292143    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8549e15-15db-4e7d-a406-b1598c2685ba-extensions-socket-volume\") pod \"f8549e15-15db-4e7d-a406-b1598c2685ba\" (UID: \"f8549e15-15db-4e7d-a406-b1598c2685ba\") "
Sep 18 13:23:37.292560 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.292536    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8549e15-15db-4e7d-a406-b1598c2685ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f8549e15-15db-4e7d-a406-b1598c2685ba" (UID: "f8549e15-15db-4e7d-a406-b1598c2685ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:23:37.294015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.293994    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8549e15-15db-4e7d-a406-b1598c2685ba-kube-api-access-ssm2c" (OuterVolumeSpecName: "kube-api-access-ssm2c") pod "f8549e15-15db-4e7d-a406-b1598c2685ba" (UID: "f8549e15-15db-4e7d-a406-b1598c2685ba"). InnerVolumeSpecName "kube-api-access-ssm2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:23:37.393057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.393033    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8549e15-15db-4e7d-a406-b1598c2685ba-extensions-socket-volume\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:23:37.393057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.393055    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssm2c\" (UniqueName: \"kubernetes.io/projected/f8549e15-15db-4e7d-a406-b1598c2685ba-kube-api-access-ssm2c\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:23:37.622865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.622804    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8549e15-15db-4e7d-a406-b1598c2685ba" containerID="084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c" exitCode=0
Sep 18 13:23:37.622865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.622849    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"
Sep 18 13:23:37.622865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.622857    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb" event={"ID":"f8549e15-15db-4e7d-a406-b1598c2685ba","Type":"ContainerDied","Data":"084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c"}
Sep 18 13:23:37.623031 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.622918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb" event={"ID":"f8549e15-15db-4e7d-a406-b1598c2685ba","Type":"ContainerDied","Data":"fab819b2846ec106d6a340049be8982cb5313650af791719d5bf9b1fb6e87767"}
Sep 18 13:23:37.623031 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.622940    2564 scope.go:117] "RemoveContainer" containerID="084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c"
Sep 18 13:23:37.631650 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.631634    2564 scope.go:117] "RemoveContainer" containerID="084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c"
Sep 18 13:23:37.631898 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:23:37.631877    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c\": container with ID starting with 084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c not found: ID does not exist" containerID="084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c"
Sep 18 13:23:37.631967 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.631909    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c"} err="failed to get container status \"084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c\": rpc error: code = NotFound desc = could not find container \"084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c\": container with ID starting with 084e51e71968cb2fdf6f15cae9948059fd039b9136d88fd07118f1c19164b56c not found: ID does not exist"
Sep 18 13:23:37.650354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.650331    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"]
Sep 18 13:23:37.657458 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:37.657439    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-frjwb"]
Sep 18 13:23:38.372604 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:38.372578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:38.530981 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:38.530956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:39.214920 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:39.214884    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8549e15-15db-4e7d-a406-b1598c2685ba" path="/var/lib/kubelet/pods/f8549e15-15db-4e7d-a406-b1598c2685ba/volumes"
Sep 18 13:23:53.617031 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.616999    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"]
Sep 18 13:23:53.617448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.617340    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8549e15-15db-4e7d-a406-b1598c2685ba" containerName="manager"
Sep 18 13:23:53.617448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.617351    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8549e15-15db-4e7d-a406-b1598c2685ba" containerName="manager"
Sep 18 13:23:53.617448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.617425    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8549e15-15db-4e7d-a406-b1598c2685ba" containerName="manager"
Sep 18 13:23:53.639391 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.639367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.642219 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.642170    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 13:23:53.642432 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.642414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5cbhl\""
Sep 18 13:23:53.643299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.643273    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"]
Sep 18 13:23:53.663161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.663139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:53.708761 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.708876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.708876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.708876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.708876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.709043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x94v\" (UniqueName: \"kubernetes.io/projected/e5cf78c8-ba21-482b-be8f-4270e3da8a18-kube-api-access-9x94v\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.709043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.709043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.709043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.708960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809774 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809774 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.809893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x94v\" (UniqueName: \"kubernetes.io/projected/e5cf78c8-ba21-482b-be8f-4270e3da8a18-kube-api-access-9x94v\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.810021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.810021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.809945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.810136 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.810121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.810295 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.810275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.810386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.810294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.810450 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.810413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.811722 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.811704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.811939 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.811924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.824333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.824308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cf78c8-ba21-482b-be8f-4270e3da8a18-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.826234 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.826215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x94v\" (UniqueName: \"kubernetes.io/projected/e5cf78c8-ba21-482b-be8f-4270e3da8a18-kube-api-access-9x94v\") pod \"maas-default-gateway-openshift-default-78bb78ff78-knht6\" (UID: \"e5cf78c8-ba21-482b-be8f-4270e3da8a18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.951292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.951243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:53.982555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:53.982531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:54.239520 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:54.239490    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"]
Sep 18 13:23:54.239839 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:23:54.239816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cf78c8_ba21_482b_be8f_4270e3da8a18.slice/crio-d7bcb8c35a493194c7f3442eabc5f3e521ec9675938ce958e1dbf20ffe1d0c73 WatchSource:0}: Error finding container d7bcb8c35a493194c7f3442eabc5f3e521ec9675938ce958e1dbf20ffe1d0c73: Status 404 returned error can't find the container with id d7bcb8c35a493194c7f3442eabc5f3e521ec9675938ce958e1dbf20ffe1d0c73
Sep 18 13:23:54.708490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:54.708419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" event={"ID":"e5cf78c8-ba21-482b-be8f-4270e3da8a18","Type":"ContainerStarted","Data":"d7bcb8c35a493194c7f3442eabc5f3e521ec9675938ce958e1dbf20ffe1d0c73"}
Sep 18 13:23:56.793777 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:56.793727    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:23:56.794047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:56.793808    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:23:56.794047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:56.793839    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:23:57.726171 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:57.726133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" event={"ID":"e5cf78c8-ba21-482b-be8f-4270e3da8a18","Type":"ContainerStarted","Data":"cc65096317441d70f4a589828e8bdd308f70fcd93bdfdbf76156e8cf3fce5ec1"}
Sep 18 13:23:57.759159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:57.759117    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" podStartSLOduration=2.207348648 podStartE2EDuration="4.759103295s" totalImagesPullingTime="2.551754647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:23:57.75609361 +0000 UTC m=+555.125353004" watchObservedRunningTime="2026-09-18 13:23:57.759103295 +0000 UTC m=+555.128362771"
Sep 18 13:23:57.857961 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:57.857921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:57.952247 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:57.952225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:57.956488 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:57.956470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:57.959314 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:57.959294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:58.731340 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.731314    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:58.732252 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.732231    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:23:58.826321 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.826288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:58.830266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.830243    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:23:58.833827 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.833812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:58.836389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.836365    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 13:23:58.843564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.843541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:23:58.943007 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.942978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:23:58.952245 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.952220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5rrp\" (UniqueName: \"kubernetes.io/projected/59cd439f-762e-444f-be95-0feb80354e7e-kube-api-access-s5rrp\") pod \"limitador-limitador-8588749977-5crkv\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") " pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:58.952387 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.952283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59cd439f-762e-444f-be95-0feb80354e7e-config-file\") pod \"limitador-limitador-8588749977-5crkv\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") " pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:58.977425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:58.977398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:59.053049 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.053022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59cd439f-762e-444f-be95-0feb80354e7e-config-file\") pod \"limitador-limitador-8588749977-5crkv\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") " pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:59.053162 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.053076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5rrp\" (UniqueName: \"kubernetes.io/projected/59cd439f-762e-444f-be95-0feb80354e7e-kube-api-access-s5rrp\") pod \"limitador-limitador-8588749977-5crkv\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") " pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:59.053637 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.053619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59cd439f-762e-444f-be95-0feb80354e7e-config-file\") pod \"limitador-limitador-8588749977-5crkv\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") " pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:59.079896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.079864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5rrp\" (UniqueName: \"kubernetes.io/projected/59cd439f-762e-444f-be95-0feb80354e7e-kube-api-access-s5rrp\") pod \"limitador-limitador-8588749977-5crkv\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") " pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:59.139239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.139188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:59.144092 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.144076    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:23:59.415311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.415289    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:23:59.417281 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:23:59.417254    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cd439f_762e_444f_be95_0feb80354e7e.slice/crio-90563c8e1c209784d3d192588d3d337a37419614336b04c05c4684182e03f14b WatchSource:0}: Error finding container 90563c8e1c209784d3d192588d3d337a37419614336b04c05c4684182e03f14b: Status 404 returned error can't find the container with id 90563c8e1c209784d3d192588d3d337a37419614336b04c05c4684182e03f14b
Sep 18 13:23:59.737890 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.737850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5crkv" event={"ID":"59cd439f-762e-444f-be95-0feb80354e7e","Type":"ContainerStarted","Data":"90563c8e1c209784d3d192588d3d337a37419614336b04c05c4684182e03f14b"}
Sep 18 13:23:59.756741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.756712    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btmkg"]
Sep 18 13:23:59.761474 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.761457    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:23:59.764073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.764055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7plsf\""
Sep 18 13:23:59.772340 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.772319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btmkg"]
Sep 18 13:23:59.799379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.799356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:59.860302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.860282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2m65\" (UniqueName: \"kubernetes.io/projected/c35eadb5-60ac-4b3c-9cc6-91f42478fced-kube-api-access-w2m65\") pod \"authorino-7bcfd8f9cd-btmkg\" (UID: \"c35eadb5-60ac-4b3c-9cc6-91f42478fced\") " pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:23:59.904067 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.904044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:23:59.912305 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.912281    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-prbqc"]
Sep 18 13:23:59.915619 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.915603    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:23:59.926904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.926883    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-prbqc"]
Sep 18 13:23:59.961050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.961024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2m65\" (UniqueName: \"kubernetes.io/projected/c35eadb5-60ac-4b3c-9cc6-91f42478fced-kube-api-access-w2m65\") pod \"authorino-7bcfd8f9cd-btmkg\" (UID: \"c35eadb5-60ac-4b3c-9cc6-91f42478fced\") " pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:23:59.961362 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.961056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82pmg\" (UniqueName: \"kubernetes.io/projected/e707f805-2758-4462-a2ac-5bb25c48f60c-kube-api-access-82pmg\") pod \"authorino-59c974bd48-prbqc\" (UID: \"e707f805-2758-4462-a2ac-5bb25c48f60c\") " pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:23:59.969911 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:23:59.969891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2m65\" (UniqueName: \"kubernetes.io/projected/c35eadb5-60ac-4b3c-9cc6-91f42478fced-kube-api-access-w2m65\") pod \"authorino-7bcfd8f9cd-btmkg\" (UID: \"c35eadb5-60ac-4b3c-9cc6-91f42478fced\") " pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:24:00.061602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.061548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82pmg\" (UniqueName: \"kubernetes.io/projected/e707f805-2758-4462-a2ac-5bb25c48f60c-kube-api-access-82pmg\") pod \"authorino-59c974bd48-prbqc\" (UID: \"e707f805-2758-4462-a2ac-5bb25c48f60c\") " pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:24:00.070342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.070322    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:24:00.071130 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.071113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82pmg\" (UniqueName: \"kubernetes.io/projected/e707f805-2758-4462-a2ac-5bb25c48f60c-kube-api-access-82pmg\") pod \"authorino-59c974bd48-prbqc\" (UID: \"e707f805-2758-4462-a2ac-5bb25c48f60c\") " pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:24:00.223653 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.223622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:24:00.339780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.339753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btmkg"]
Sep 18 13:24:00.476774 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:24:00.476737    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc35eadb5_60ac_4b3c_9cc6_91f42478fced.slice/crio-c282ecfd3528f17801f2cda4a15aeadd3448f2595db5b3f39ec3265abe4a99e7 WatchSource:0}: Error finding container c282ecfd3528f17801f2cda4a15aeadd3448f2595db5b3f39ec3265abe4a99e7: Status 404 returned error can't find the container with id c282ecfd3528f17801f2cda4a15aeadd3448f2595db5b3f39ec3265abe4a99e7
Sep 18 13:24:00.499143 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.499118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-prbqc"]
Sep 18 13:24:00.530829 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:24:00.530796    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode707f805_2758_4462_a2ac_5bb25c48f60c.slice/crio-3c7ce0d3eee8227476a1b510875f9ee962a2d1f9cc06a51f1894d992b271c12c WatchSource:0}: Error finding container 3c7ce0d3eee8227476a1b510875f9ee962a2d1f9cc06a51f1894d992b271c12c: Status 404 returned error can't find the container with id 3c7ce0d3eee8227476a1b510875f9ee962a2d1f9cc06a51f1894d992b271c12c
Sep 18 13:24:00.744854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.744825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5crkv" event={"ID":"59cd439f-762e-444f-be95-0feb80354e7e","Type":"ContainerStarted","Data":"d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff"}
Sep 18 13:24:00.744981 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.744891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:24:00.746095 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.746074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg" event={"ID":"c35eadb5-60ac-4b3c-9cc6-91f42478fced","Type":"ContainerStarted","Data":"c282ecfd3528f17801f2cda4a15aeadd3448f2595db5b3f39ec3265abe4a99e7"}
Sep 18 13:24:00.747233 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.747214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-prbqc" event={"ID":"e707f805-2758-4462-a2ac-5bb25c48f60c","Type":"ContainerStarted","Data":"3c7ce0d3eee8227476a1b510875f9ee962a2d1f9cc06a51f1894d992b271c12c"}
Sep 18 13:24:00.773000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:00.772956    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5crkv" podStartSLOduration=1.6564498460000001 podStartE2EDuration="2.772940941s" totalImagesPullingTime="1.116491095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:00.77069294 +0000 UTC m=+558.139952335" watchObservedRunningTime="2026-09-18 13:24:00.772940941 +0000 UTC m=+558.142200367"
Sep 18 13:24:02.761426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:02.761384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg" event={"ID":"c35eadb5-60ac-4b3c-9cc6-91f42478fced","Type":"ContainerStarted","Data":"c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219"}
Sep 18 13:24:02.762906 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:02.762881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-prbqc" event={"ID":"e707f805-2758-4462-a2ac-5bb25c48f60c","Type":"ContainerStarted","Data":"6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0"}
Sep 18 13:24:02.777390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:02.777344    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg" podStartSLOduration=1.8090799739999999 podStartE2EDuration="3.777329753s" totalImagesPullingTime="1.968249779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:02.776796746 +0000 UTC m=+560.146056129" watchObservedRunningTime="2026-09-18 13:24:02.777329753 +0000 UTC m=+560.146589134"
Sep 18 13:24:02.795372 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:02.795330    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-prbqc" podStartSLOduration=1.876549637 podStartE2EDuration="3.795317886s" totalImagesPullingTime="1.918768249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:02.793048795 +0000 UTC m=+560.162308178" watchObservedRunningTime="2026-09-18 13:24:02.795317886 +0000 UTC m=+560.164577268"
Sep 18 13:24:02.824721 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:02.824680    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btmkg"]
Sep 18 13:24:04.773813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:04.773774    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg" podUID="c35eadb5-60ac-4b3c-9cc6-91f42478fced" containerName="authorino" containerID="cri-o://c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219" gracePeriod=30
Sep 18 13:24:05.010867 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.010842    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:24:05.105137 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.105085    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2m65\" (UniqueName: \"kubernetes.io/projected/c35eadb5-60ac-4b3c-9cc6-91f42478fced-kube-api-access-w2m65\") pod \"c35eadb5-60ac-4b3c-9cc6-91f42478fced\" (UID: \"c35eadb5-60ac-4b3c-9cc6-91f42478fced\") "
Sep 18 13:24:05.106932 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.106903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35eadb5-60ac-4b3c-9cc6-91f42478fced-kube-api-access-w2m65" (OuterVolumeSpecName: "kube-api-access-w2m65") pod "c35eadb5-60ac-4b3c-9cc6-91f42478fced" (UID: "c35eadb5-60ac-4b3c-9cc6-91f42478fced"). InnerVolumeSpecName "kube-api-access-w2m65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:24:05.206058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.206038    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2m65\" (UniqueName: \"kubernetes.io/projected/c35eadb5-60ac-4b3c-9cc6-91f42478fced-kube-api-access-w2m65\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:05.780394 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.780371    2564 generic.go:356] "Generic (PLEG): container finished" podID="c35eadb5-60ac-4b3c-9cc6-91f42478fced" containerID="c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219" exitCode=0
Sep 18 13:24:05.780729 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.780406    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg"
Sep 18 13:24:05.780729 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.780428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg" event={"ID":"c35eadb5-60ac-4b3c-9cc6-91f42478fced","Type":"ContainerDied","Data":"c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219"}
Sep 18 13:24:05.780729 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.780470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-btmkg" event={"ID":"c35eadb5-60ac-4b3c-9cc6-91f42478fced","Type":"ContainerDied","Data":"c282ecfd3528f17801f2cda4a15aeadd3448f2595db5b3f39ec3265abe4a99e7"}
Sep 18 13:24:05.780729 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.780488    2564 scope.go:117] "RemoveContainer" containerID="c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219"
Sep 18 13:24:05.789087 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.789063    2564 scope.go:117] "RemoveContainer" containerID="c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219"
Sep 18 13:24:05.789354 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:05.789336    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219\": container with ID starting with c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219 not found: ID does not exist" containerID="c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219"
Sep 18 13:24:05.789424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.789368    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219"} err="failed to get container status \"c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219\": rpc error: code = NotFound desc = could not find container \"c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219\": container with ID starting with c3b8529cfdcd7daeda0cb411390e5ab7ff474dd50d8ec866f0453954a6fb6219 not found: ID does not exist"
Sep 18 13:24:05.805712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.805692    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btmkg"]
Sep 18 13:24:05.815639 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:05.815618    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-btmkg"]
Sep 18 13:24:07.214498 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:07.214466    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35eadb5-60ac-4b3c-9cc6-91f42478fced" path="/var/lib/kubelet/pods/c35eadb5-60ac-4b3c-9cc6-91f42478fced/volumes"
Sep 18 13:24:11.755352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:11.755322    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:24:12.122669 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.122599    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:24:12.122812 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.122755    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5crkv" podUID="59cd439f-762e-444f-be95-0feb80354e7e" containerName="limitador" containerID="cri-o://d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff" gracePeriod=30
Sep 18 13:24:12.665804 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.665783    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:24:12.761657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.761636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5rrp\" (UniqueName: \"kubernetes.io/projected/59cd439f-762e-444f-be95-0feb80354e7e-kube-api-access-s5rrp\") pod \"59cd439f-762e-444f-be95-0feb80354e7e\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") "
Sep 18 13:24:12.761936 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.761679    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59cd439f-762e-444f-be95-0feb80354e7e-config-file\") pod \"59cd439f-762e-444f-be95-0feb80354e7e\" (UID: \"59cd439f-762e-444f-be95-0feb80354e7e\") "
Sep 18 13:24:12.762068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.762046    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59cd439f-762e-444f-be95-0feb80354e7e-config-file" (OuterVolumeSpecName: "config-file") pod "59cd439f-762e-444f-be95-0feb80354e7e" (UID: "59cd439f-762e-444f-be95-0feb80354e7e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:24:12.763583 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.763564    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59cd439f-762e-444f-be95-0feb80354e7e-kube-api-access-s5rrp" (OuterVolumeSpecName: "kube-api-access-s5rrp") pod "59cd439f-762e-444f-be95-0feb80354e7e" (UID: "59cd439f-762e-444f-be95-0feb80354e7e"). InnerVolumeSpecName "kube-api-access-s5rrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:24:12.818992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.818961    2564 generic.go:356] "Generic (PLEG): container finished" podID="59cd439f-762e-444f-be95-0feb80354e7e" containerID="d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff" exitCode=0
Sep 18 13:24:12.819101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.819007    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5crkv"
Sep 18 13:24:12.819101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.819050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5crkv" event={"ID":"59cd439f-762e-444f-be95-0feb80354e7e","Type":"ContainerDied","Data":"d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff"}
Sep 18 13:24:12.819177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.819103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5crkv" event={"ID":"59cd439f-762e-444f-be95-0feb80354e7e","Type":"ContainerDied","Data":"90563c8e1c209784d3d192588d3d337a37419614336b04c05c4684182e03f14b"}
Sep 18 13:24:12.819177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.819127    2564 scope.go:117] "RemoveContainer" containerID="d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff"
Sep 18 13:24:12.827786 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.827767    2564 scope.go:117] "RemoveContainer" containerID="d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff"
Sep 18 13:24:12.828052 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:12.828034    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff\": container with ID starting with d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff not found: ID does not exist" containerID="d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff"
Sep 18 13:24:12.828102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.828061    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff"} err="failed to get container status \"d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff\": rpc error: code = NotFound desc = could not find container \"d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff\": container with ID starting with d11e748f76293f75e2dbeb06e40043a210da10b19b142679829688f0462f21ff not found: ID does not exist"
Sep 18 13:24:12.841600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.841566    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:24:12.847064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.847043    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5crkv"]
Sep 18 13:24:12.863182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.863161    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5rrp\" (UniqueName: \"kubernetes.io/projected/59cd439f-762e-444f-be95-0feb80354e7e-kube-api-access-s5rrp\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:12.863182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:12.863182    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59cd439f-762e-444f-be95-0feb80354e7e-config-file\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:13.220483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:13.220418    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59cd439f-762e-444f-be95-0feb80354e7e" path="/var/lib/kubelet/pods/59cd439f-762e-444f-be95-0feb80354e7e/volumes"
Sep 18 13:24:15.099103 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.099069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:15.197216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.197174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:15.575090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575059    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"]
Sep 18 13:24:15.575440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575425    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35eadb5-60ac-4b3c-9cc6-91f42478fced" containerName="authorino"
Sep 18 13:24:15.575498 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575442    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35eadb5-60ac-4b3c-9cc6-91f42478fced" containerName="authorino"
Sep 18 13:24:15.575498 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575451    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59cd439f-762e-444f-be95-0feb80354e7e" containerName="limitador"
Sep 18 13:24:15.575498 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575457    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59cd439f-762e-444f-be95-0feb80354e7e" containerName="limitador"
Sep 18 13:24:15.575606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575513    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="59cd439f-762e-444f-be95-0feb80354e7e" containerName="limitador"
Sep 18 13:24:15.575606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.575519    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35eadb5-60ac-4b3c-9cc6-91f42478fced" containerName="authorino"
Sep 18 13:24:15.580058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.580042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.582863 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.582846    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-772bx\""
Sep 18 13:24:15.582960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.582845    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 13:24:15.583960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.583942    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 13:24:15.584057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.583971    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 13:24:15.591904 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.591883    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"]
Sep 18 13:24:15.629048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.629022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:15.683302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.683279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpfvr\" (UniqueName: \"kubernetes.io/projected/92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8-kube-api-access-hpfvr\") pod \"postgres-69fb4594cf-6rp6k\" (UID: \"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.683407 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.683343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8-data\") pod \"postgres-69fb4594cf-6rp6k\" (UID: \"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.783946 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.783921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpfvr\" (UniqueName: \"kubernetes.io/projected/92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8-kube-api-access-hpfvr\") pod \"postgres-69fb4594cf-6rp6k\" (UID: \"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.784042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.783982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8-data\") pod \"postgres-69fb4594cf-6rp6k\" (UID: \"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.784295 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.784281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8-data\") pod \"postgres-69fb4594cf-6rp6k\" (UID: \"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.792290 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.792273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpfvr\" (UniqueName: \"kubernetes.io/projected/92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8-kube-api-access-hpfvr\") pod \"postgres-69fb4594cf-6rp6k\" (UID: \"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:15.891007 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:15.890959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:16.168173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:16.168112    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"]
Sep 18 13:24:16.171570 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:24:16.171544    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92637d72_0b9c_40b9_b8a3_4efc1dd9fbd8.slice/crio-e81ed430ca5717b3630d3733b87a45ee08acd43e05db6d4333b5648646fd1614 WatchSource:0}: Error finding container e81ed430ca5717b3630d3733b87a45ee08acd43e05db6d4333b5648646fd1614: Status 404 returned error can't find the container with id e81ed430ca5717b3630d3733b87a45ee08acd43e05db6d4333b5648646fd1614
Sep 18 13:24:16.844250 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:16.844220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k" event={"ID":"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8","Type":"ContainerStarted","Data":"e81ed430ca5717b3630d3733b87a45ee08acd43e05db6d4333b5648646fd1614"}
Sep 18 13:24:20.844975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:20.844925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:21.874986 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:21.874953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k" event={"ID":"92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8","Type":"ContainerStarted","Data":"f787c67be531fd71c8a9f0403b20097aa3993d21ff04899229137145497d8f1e"}
Sep 18 13:24:21.875426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:21.875127    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:21.895436 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:21.895385    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k" podStartSLOduration=2.16252443 podStartE2EDuration="6.895369019s" totalImagesPullingTime="4.732844589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:21.89352049 +0000 UTC m=+579.262779873" watchObservedRunningTime="2026-09-18 13:24:21.895369019 +0000 UTC m=+579.264628402"
Sep 18 13:24:27.909700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:27.909671    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6rp6k"
Sep 18 13:24:28.250687 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.250656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:28.495130 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.495101    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-c4rfm"]
Sep 18 13:24:28.501537 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.501486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:28.506157 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.506130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-c4rfm"]
Sep 18 13:24:28.585563 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.585533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ds2h\" (UniqueName: \"kubernetes.io/projected/c905af3f-1d93-496e-a8da-176bab5e6482-kube-api-access-7ds2h\") pod \"authorino-557f876f69-c4rfm\" (UID: \"c905af3f-1d93-496e-a8da-176bab5e6482\") " pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:28.632157 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.632123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:28.679050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.679027    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-c4rfm"]
Sep 18 13:24:28.679219 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:28.679186    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7ds2h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-c4rfm" podUID="c905af3f-1d93-496e-a8da-176bab5e6482"
Sep 18 13:24:28.685950 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.685927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ds2h\" (UniqueName: \"kubernetes.io/projected/c905af3f-1d93-496e-a8da-176bab5e6482-kube-api-access-7ds2h\") pod \"authorino-557f876f69-c4rfm\" (UID: \"c905af3f-1d93-496e-a8da-176bab5e6482\") " pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:28.704123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.704096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ds2h\" (UniqueName: \"kubernetes.io/projected/c905af3f-1d93-496e-a8da-176bab5e6482-kube-api-access-7ds2h\") pod \"authorino-557f876f69-c4rfm\" (UID: \"c905af3f-1d93-496e-a8da-176bab5e6482\") " pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:28.711293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.711274    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8kmvq"]
Sep 18 13:24:28.715503 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.715487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.718148 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.718128    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 13:24:28.727492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.727470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8kmvq"]
Sep 18 13:24:28.787107 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.787042    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8kmvq"]
Sep 18 13:24:28.787229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.787176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/059c6056-a060-4e62-a266-193c64e25be0-tls-cert\") pod \"authorino-6d4dfc649f-8kmvq\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") " pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.787229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.787216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9jhd\" (UniqueName: \"kubernetes.io/projected/059c6056-a060-4e62-a266-193c64e25be0-kube-api-access-g9jhd\") pod \"authorino-6d4dfc649f-8kmvq\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") " pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.787351 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:28.787285    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g9jhd tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-8kmvq" podUID="059c6056-a060-4e62-a266-193c64e25be0"
Sep 18 13:24:28.826943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.826918    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65b9976c5d-gx8ps"]
Sep 18 13:24:28.831038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.831020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:28.858494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.858470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b9976c5d-gx8ps"]
Sep 18 13:24:28.888497 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.888473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/059c6056-a060-4e62-a266-193c64e25be0-tls-cert\") pod \"authorino-6d4dfc649f-8kmvq\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") " pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.888579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.888504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9jhd\" (UniqueName: \"kubernetes.io/projected/059c6056-a060-4e62-a266-193c64e25be0-kube-api-access-g9jhd\") pod \"authorino-6d4dfc649f-8kmvq\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") " pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.891389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.891364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/059c6056-a060-4e62-a266-193c64e25be0-tls-cert\") pod \"authorino-6d4dfc649f-8kmvq\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") " pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.899286 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.899266    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9jhd\" (UniqueName: \"kubernetes.io/projected/059c6056-a060-4e62-a266-193c64e25be0-kube-api-access-g9jhd\") pod \"authorino-6d4dfc649f-8kmvq\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") " pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.911117 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.911100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.911407 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.911102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:28.918777 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.918762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:28.922078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.922060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:28.989711 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.989691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39a40812-998e-435d-a4d5-8c9dd8f50b9d-tls-cert\") pod \"authorino-65b9976c5d-gx8ps\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") " pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:28.989804 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:28.989718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whnm5\" (UniqueName: \"kubernetes.io/projected/39a40812-998e-435d-a4d5-8c9dd8f50b9d-kube-api-access-whnm5\") pod \"authorino-65b9976c5d-gx8ps\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") " pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:29.090380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.090320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9jhd\" (UniqueName: \"kubernetes.io/projected/059c6056-a060-4e62-a266-193c64e25be0-kube-api-access-g9jhd\") pod \"059c6056-a060-4e62-a266-193c64e25be0\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") "
Sep 18 13:24:29.090485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.090398    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ds2h\" (UniqueName: \"kubernetes.io/projected/c905af3f-1d93-496e-a8da-176bab5e6482-kube-api-access-7ds2h\") pod \"c905af3f-1d93-496e-a8da-176bab5e6482\" (UID: \"c905af3f-1d93-496e-a8da-176bab5e6482\") "
Sep 18 13:24:29.090485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.090451    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/059c6056-a060-4e62-a266-193c64e25be0-tls-cert\") pod \"059c6056-a060-4e62-a266-193c64e25be0\" (UID: \"059c6056-a060-4e62-a266-193c64e25be0\") "
Sep 18 13:24:29.090603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.090562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39a40812-998e-435d-a4d5-8c9dd8f50b9d-tls-cert\") pod \"authorino-65b9976c5d-gx8ps\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") " pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:29.090603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.090591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whnm5\" (UniqueName: \"kubernetes.io/projected/39a40812-998e-435d-a4d5-8c9dd8f50b9d-kube-api-access-whnm5\") pod \"authorino-65b9976c5d-gx8ps\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") " pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:29.092633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.092605    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c905af3f-1d93-496e-a8da-176bab5e6482-kube-api-access-7ds2h" (OuterVolumeSpecName: "kube-api-access-7ds2h") pod "c905af3f-1d93-496e-a8da-176bab5e6482" (UID: "c905af3f-1d93-496e-a8da-176bab5e6482"). InnerVolumeSpecName "kube-api-access-7ds2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:24:29.092741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.092635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059c6056-a060-4e62-a266-193c64e25be0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "059c6056-a060-4e62-a266-193c64e25be0" (UID: "059c6056-a060-4e62-a266-193c64e25be0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:24:29.092741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.092638    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/059c6056-a060-4e62-a266-193c64e25be0-kube-api-access-g9jhd" (OuterVolumeSpecName: "kube-api-access-g9jhd") pod "059c6056-a060-4e62-a266-193c64e25be0" (UID: "059c6056-a060-4e62-a266-193c64e25be0"). InnerVolumeSpecName "kube-api-access-g9jhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:24:29.092967 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.092948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39a40812-998e-435d-a4d5-8c9dd8f50b9d-tls-cert\") pod \"authorino-65b9976c5d-gx8ps\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") " pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:29.100615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.100597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whnm5\" (UniqueName: \"kubernetes.io/projected/39a40812-998e-435d-a4d5-8c9dd8f50b9d-kube-api-access-whnm5\") pod \"authorino-65b9976c5d-gx8ps\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") " pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:29.139411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.139392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:24:29.191842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.191812    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ds2h\" (UniqueName: \"kubernetes.io/projected/c905af3f-1d93-496e-a8da-176bab5e6482-kube-api-access-7ds2h\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:29.191938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.191847    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/059c6056-a060-4e62-a266-193c64e25be0-tls-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:29.191938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.191863    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9jhd\" (UniqueName: \"kubernetes.io/projected/059c6056-a060-4e62-a266-193c64e25be0-kube-api-access-g9jhd\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:29.414619 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.414595    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b9976c5d-gx8ps"]
Sep 18 13:24:29.416691 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:24:29.416668    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39a40812_998e_435d_a4d5_8c9dd8f50b9d.slice/crio-6b7cc8b63cc8fcce7f27cf140398f0ec08c3ea126483675083fca953069eea6c WatchSource:0}: Error finding container 6b7cc8b63cc8fcce7f27cf140398f0ec08c3ea126483675083fca953069eea6c: Status 404 returned error can't find the container with id 6b7cc8b63cc8fcce7f27cf140398f0ec08c3ea126483675083fca953069eea6c
Sep 18 13:24:29.919036 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.919012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b9976c5d-gx8ps" event={"ID":"39a40812-998e-435d-a4d5-8c9dd8f50b9d","Type":"ContainerStarted","Data":"6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6"}
Sep 18 13:24:29.919348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.919050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b9976c5d-gx8ps" event={"ID":"39a40812-998e-435d-a4d5-8c9dd8f50b9d","Type":"ContainerStarted","Data":"6b7cc8b63cc8fcce7f27cf140398f0ec08c3ea126483675083fca953069eea6c"}
Sep 18 13:24:29.919348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.919122    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-c4rfm"
Sep 18 13:24:29.919348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.919136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8kmvq"
Sep 18 13:24:29.962675 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:29.962597    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65b9976c5d-gx8ps" podStartSLOduration=1.534084408 podStartE2EDuration="1.962576332s" totalImagesPullingTime="428.491924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:29.959058191 +0000 UTC m=+587.328317573" watchObservedRunningTime="2026-09-18 13:24:29.962576332 +0000 UTC m=+587.331835715"
Sep 18 13:24:30.027663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.027630    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-prbqc"]
Sep 18 13:24:30.027898 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.027868    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-prbqc" podUID="e707f805-2758-4462-a2ac-5bb25c48f60c" containerName="authorino" containerID="cri-o://6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0" gracePeriod=30
Sep 18 13:24:30.043964 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.043942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8kmvq"]
Sep 18 13:24:30.061354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.061329    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8kmvq"]
Sep 18 13:24:30.122131 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.122062    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-c4rfm"]
Sep 18 13:24:30.131516 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.131491    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-c4rfm"]
Sep 18 13:24:30.256528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.256505    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:24:30.401457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.401378    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82pmg\" (UniqueName: \"kubernetes.io/projected/e707f805-2758-4462-a2ac-5bb25c48f60c-kube-api-access-82pmg\") pod \"e707f805-2758-4462-a2ac-5bb25c48f60c\" (UID: \"e707f805-2758-4462-a2ac-5bb25c48f60c\") "
Sep 18 13:24:30.403140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.403115    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e707f805-2758-4462-a2ac-5bb25c48f60c-kube-api-access-82pmg" (OuterVolumeSpecName: "kube-api-access-82pmg") pod "e707f805-2758-4462-a2ac-5bb25c48f60c" (UID: "e707f805-2758-4462-a2ac-5bb25c48f60c"). InnerVolumeSpecName "kube-api-access-82pmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:24:30.502644 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.502624    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82pmg\" (UniqueName: \"kubernetes.io/projected/e707f805-2758-4462-a2ac-5bb25c48f60c-kube-api-access-82pmg\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:30.926091 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.926061    2564 generic.go:356] "Generic (PLEG): container finished" podID="e707f805-2758-4462-a2ac-5bb25c48f60c" containerID="6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0" exitCode=0
Sep 18 13:24:30.926449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.926097    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-prbqc"
Sep 18 13:24:30.926449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.926150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-prbqc" event={"ID":"e707f805-2758-4462-a2ac-5bb25c48f60c","Type":"ContainerDied","Data":"6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0"}
Sep 18 13:24:30.926449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.926189    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-prbqc" event={"ID":"e707f805-2758-4462-a2ac-5bb25c48f60c","Type":"ContainerDied","Data":"3c7ce0d3eee8227476a1b510875f9ee962a2d1f9cc06a51f1894d992b271c12c"}
Sep 18 13:24:30.926449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.926219    2564 scope.go:117] "RemoveContainer" containerID="6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0"
Sep 18 13:24:30.934746 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.934730    2564 scope.go:117] "RemoveContainer" containerID="6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0"
Sep 18 13:24:30.934988 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:30.934972    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0\": container with ID starting with 6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0 not found: ID does not exist" containerID="6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0"
Sep 18 13:24:30.935032 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.934994    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0"} err="failed to get container status \"6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0\": rpc error: code = NotFound desc = could not find container \"6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0\": container with ID starting with 6786be85702ca024796517917ee2dd8a702113390c69c5088c96bac453de46b0 not found: ID does not exist"
Sep 18 13:24:30.949277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.949254    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-prbqc"]
Sep 18 13:24:30.954349 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:30.954331    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-prbqc"]
Sep 18 13:24:31.214271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:31.214248    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="059c6056-a060-4e62-a266-193c64e25be0" path="/var/lib/kubelet/pods/059c6056-a060-4e62-a266-193c64e25be0/volumes"
Sep 18 13:24:31.214460 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:31.214448    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c905af3f-1d93-496e-a8da-176bab5e6482" path="/var/lib/kubelet/pods/c905af3f-1d93-496e-a8da-176bab5e6482/volumes"
Sep 18 13:24:31.214638 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:31.214628    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e707f805-2758-4462-a2ac-5bb25c48f60c" path="/var/lib/kubelet/pods/e707f805-2758-4462-a2ac-5bb25c48f60c/volumes"
Sep 18 13:24:35.316861 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.316823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:35.370732 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.370702    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54b77c8564-zjw4n"]
Sep 18 13:24:35.371046 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.371034    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e707f805-2758-4462-a2ac-5bb25c48f60c" containerName="authorino"
Sep 18 13:24:35.371096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.371048    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e707f805-2758-4462-a2ac-5bb25c48f60c" containerName="authorino"
Sep 18 13:24:35.371143 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.371120    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e707f805-2758-4462-a2ac-5bb25c48f60c" containerName="authorino"
Sep 18 13:24:35.400046 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.400023    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b77c8564-zjw4n"]
Sep 18 13:24:35.400166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.400111    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.402731 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.402705    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 13:24:35.402860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.402726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6grfs\""
Sep 18 13:24:35.402860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.402727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 13:24:35.403686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.403673    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 13:24:35.422533 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.422509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:35.516268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.516247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:35.538772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.538748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-metrics-certs\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.538862 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.538796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx6jc\" (UniqueName: \"kubernetes.io/projected/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-kube-api-access-zx6jc\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.538862 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.538845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.572929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.572878    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65c4f9d49-phh8w"]
Sep 18 13:24:35.576532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.576516    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.587818 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.587795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-phh8w"]
Sep 18 13:24:35.611158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.611132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:35.640228 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.640175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-metrics-certs\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.640306 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.640270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx6jc\" (UniqueName: \"kubernetes.io/projected/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-kube-api-access-zx6jc\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.640306 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.640298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.640412 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:35.640397    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 18 13:24:35.640474 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:35.640463    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert podName:cf839aaf-316c-4a8a-8b98-c57d4567e7bb nodeName:}" failed. No retries permitted until 2026-09-18 13:24:36.140445856 +0000 UTC m=+593.509705219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert") pod "maas-controller-54b77c8564-zjw4n" (UID: "cf839aaf-316c-4a8a-8b98-c57d4567e7bb") : secret "maas-controller-webhook-cert" not found
Sep 18 13:24:35.642452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.642428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-metrics-certs\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.648481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.648462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx6jc\" (UniqueName: \"kubernetes.io/projected/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-kube-api-access-zx6jc\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:35.740858 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.740835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcvvx\" (UniqueName: \"kubernetes.io/projected/23eae345-7b4a-452a-96bc-84a64a437a54-kube-api-access-qcvvx\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.741052 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.740871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.741052 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.740951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-metrics-certs\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.841404 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.841348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-metrics-certs\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.841484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.841406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvvx\" (UniqueName: \"kubernetes.io/projected/23eae345-7b4a-452a-96bc-84a64a437a54-kube-api-access-qcvvx\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.841484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.841442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.841563 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:35.841542    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 18 13:24:35.841604 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:35.841598    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert podName:23eae345-7b4a-452a-96bc-84a64a437a54 nodeName:}" failed. No retries permitted until 2026-09-18 13:24:36.341579556 +0000 UTC m=+593.710838917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert") pod "maas-controller-65c4f9d49-phh8w" (UID: "23eae345-7b4a-452a-96bc-84a64a437a54") : secret "maas-controller-webhook-cert" not found
Sep 18 13:24:35.843445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.843430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-metrics-certs\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:35.852074 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:35.852053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcvvx\" (UniqueName: \"kubernetes.io/projected/23eae345-7b4a-452a-96bc-84a64a437a54-kube-api-access-qcvvx\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:36.067334 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.067306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:36.143437 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.143388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:36.145494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.145466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert\") pod \"maas-controller-54b77c8564-zjw4n\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") " pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:36.310480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.310456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:36.345089 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.345064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:36.347749 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.347423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert\") pod \"maas-controller-65c4f9d49-phh8w\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") " pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:36.486477 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.486454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:36.587610 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.587584    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b77c8564-zjw4n"]
Sep 18 13:24:36.588423 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:24:36.588394    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf839aaf_316c_4a8a_8b98_c57d4567e7bb.slice/crio-f4231b86f45dff0fc8df63237f808627c3406637b3ee4ea5b4f61b924c91c0f7 WatchSource:0}: Error finding container f4231b86f45dff0fc8df63237f808627c3406637b3ee4ea5b4f61b924c91c0f7: Status 404 returned error can't find the container with id f4231b86f45dff0fc8df63237f808627c3406637b3ee4ea5b4f61b924c91c0f7
Sep 18 13:24:36.759922 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.759901    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-phh8w"]
Sep 18 13:24:36.761783 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:24:36.761758    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23eae345_7b4a_452a_96bc_84a64a437a54.slice/crio-332e731b1c738176e34ebc426d1de334a169f0269283084a3c7f63990463db1c WatchSource:0}: Error finding container 332e731b1c738176e34ebc426d1de334a169f0269283084a3c7f63990463db1c: Status 404 returned error can't find the container with id 332e731b1c738176e34ebc426d1de334a169f0269283084a3c7f63990463db1c
Sep 18 13:24:36.960894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.960863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b77c8564-zjw4n" event={"ID":"cf839aaf-316c-4a8a-8b98-c57d4567e7bb","Type":"ContainerStarted","Data":"f4231b86f45dff0fc8df63237f808627c3406637b3ee4ea5b4f61b924c91c0f7"}
Sep 18 13:24:36.962017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:36.961993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-phh8w" event={"ID":"23eae345-7b4a-452a-96bc-84a64a437a54","Type":"ContainerStarted","Data":"332e731b1c738176e34ebc426d1de334a169f0269283084a3c7f63990463db1c"}
Sep 18 13:24:39.558045 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:39.557964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:39.725613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:39.725584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:39.989766 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:39.989728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-phh8w" event={"ID":"23eae345-7b4a-452a-96bc-84a64a437a54","Type":"ContainerStarted","Data":"85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c"}
Sep 18 13:24:39.989931 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:39.989793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:39.991276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:39.991252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b77c8564-zjw4n" event={"ID":"cf839aaf-316c-4a8a-8b98-c57d4567e7bb","Type":"ContainerStarted","Data":"d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41"}
Sep 18 13:24:39.991412 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:39.991392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:40.009947 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:40.009900    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65c4f9d49-phh8w" podStartSLOduration=2.479229105 podStartE2EDuration="5.009887112s" totalImagesPullingTime="2.530658007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:40.009540558 +0000 UTC m=+597.378799940" watchObservedRunningTime="2026-09-18 13:24:40.009887112 +0000 UTC m=+597.379146493"
Sep 18 13:24:40.041518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:40.041468    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54b77c8564-zjw4n" podStartSLOduration=2.347556978 podStartE2EDuration="5.0414495s" totalImagesPullingTime="2.693892522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:24:40.038141648 +0000 UTC m=+597.407401031" watchObservedRunningTime="2026-09-18 13:24:40.0414495 +0000 UTC m=+597.410708884"
Sep 18 13:24:40.163341 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:40.163298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:24:43.090510 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:43.090479    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:24:43.097161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:43.097138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:24:50.998887 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:50.998859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:51.001316 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:50.999015    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:24:51.074392 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.074359    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b77c8564-zjw4n"]
Sep 18 13:24:51.074603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.074579    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54b77c8564-zjw4n" podUID="cf839aaf-316c-4a8a-8b98-c57d4567e7bb" containerName="manager" containerID="cri-o://d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41" gracePeriod=30
Sep 18 13:24:51.309060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.309033    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:51.464703 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.464676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert\") pod \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") "
Sep 18 13:24:51.464861 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.464766    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx6jc\" (UniqueName: \"kubernetes.io/projected/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-kube-api-access-zx6jc\") pod \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") "
Sep 18 13:24:51.464861 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.464810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-metrics-certs\") pod \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\" (UID: \"cf839aaf-316c-4a8a-8b98-c57d4567e7bb\") "
Sep 18 13:24:51.466715 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.466689    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cf839aaf-316c-4a8a-8b98-c57d4567e7bb" (UID: "cf839aaf-316c-4a8a-8b98-c57d4567e7bb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:24:51.466813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.466783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-kube-api-access-zx6jc" (OuterVolumeSpecName: "kube-api-access-zx6jc") pod "cf839aaf-316c-4a8a-8b98-c57d4567e7bb" (UID: "cf839aaf-316c-4a8a-8b98-c57d4567e7bb"). InnerVolumeSpecName "kube-api-access-zx6jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:24:51.466813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.466787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cf839aaf-316c-4a8a-8b98-c57d4567e7bb" (UID: "cf839aaf-316c-4a8a-8b98-c57d4567e7bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:24:51.565663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.565612    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx6jc\" (UniqueName: \"kubernetes.io/projected/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-kube-api-access-zx6jc\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:51.565663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.565633    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:51.565663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:51.565641    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf839aaf-316c-4a8a-8b98-c57d4567e7bb-webhook-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:24:52.055499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.055471    2564 generic.go:356] "Generic (PLEG): container finished" podID="cf839aaf-316c-4a8a-8b98-c57d4567e7bb" containerID="d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41" exitCode=0
Sep 18 13:24:52.055772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.055509    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b77c8564-zjw4n"
Sep 18 13:24:52.055772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.055560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b77c8564-zjw4n" event={"ID":"cf839aaf-316c-4a8a-8b98-c57d4567e7bb","Type":"ContainerDied","Data":"d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41"}
Sep 18 13:24:52.055772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.055606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b77c8564-zjw4n" event={"ID":"cf839aaf-316c-4a8a-8b98-c57d4567e7bb","Type":"ContainerDied","Data":"f4231b86f45dff0fc8df63237f808627c3406637b3ee4ea5b4f61b924c91c0f7"}
Sep 18 13:24:52.055772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.055628    2564 scope.go:117] "RemoveContainer" containerID="d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41"
Sep 18 13:24:52.065351 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.065337    2564 scope.go:117] "RemoveContainer" containerID="d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41"
Sep 18 13:24:52.065604 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:24:52.065586    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41\": container with ID starting with d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41 not found: ID does not exist" containerID="d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41"
Sep 18 13:24:52.065672 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.065611    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41"} err="failed to get container status \"d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41\": rpc error: code = NotFound desc = could not find container \"d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41\": container with ID starting with d337882e906a53b5891547980de6c073f4c1157a44791cd33689f40dafc93b41 not found: ID does not exist"
Sep 18 13:24:52.080900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.080876    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b77c8564-zjw4n"]
Sep 18 13:24:52.090908 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:52.090886    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54b77c8564-zjw4n"]
Sep 18 13:24:53.219594 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:24:53.219564    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf839aaf-316c-4a8a-8b98-c57d4567e7bb" path="/var/lib/kubelet/pods/cf839aaf-316c-4a8a-8b98-c57d4567e7bb/volumes"
Sep 18 13:25:00.213731 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:00.213701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:00.316848 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:00.316819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:11.212853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:11.212766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:11.359605 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:11.359571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:12.764739 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.764692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:12.868481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.868451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:12.940551 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.940525    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b89985555-ls92w"]
Sep 18 13:25:12.940917 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.940903    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf839aaf-316c-4a8a-8b98-c57d4567e7bb" containerName="manager"
Sep 18 13:25:12.940968 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.940919    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf839aaf-316c-4a8a-8b98-c57d4567e7bb" containerName="manager"
Sep 18 13:25:12.941003 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.940985    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf839aaf-316c-4a8a-8b98-c57d4567e7bb" containerName="manager"
Sep 18 13:25:12.946599 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.946584    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:12.950536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.950514    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 13:25:12.950675 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.950572    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 13:25:12.950675 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.950572    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ffxkp\""
Sep 18 13:25:12.970188 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:12.970164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b89985555-ls92w"]
Sep 18 13:25:13.019216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.019150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-maas-api-tls\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.019320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.019217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672b955a-f3b1-44c3-8731-fb82f2e7662a-openshift-service-ca\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.019320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.019245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9n5\" (UniqueName: \"kubernetes.io/projected/672b955a-f3b1-44c3-8731-fb82f2e7662a-kube-api-access-lc9n5\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.019320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.019266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.120011 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.119984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-maas-api-tls\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.120140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.120040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672b955a-f3b1-44c3-8731-fb82f2e7662a-openshift-service-ca\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.120140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.120069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9n5\" (UniqueName: \"kubernetes.io/projected/672b955a-f3b1-44c3-8731-fb82f2e7662a-kube-api-access-lc9n5\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.120140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.120098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.120328 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:25:13.120260    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 18 13:25:13.120328 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:25:13.120325    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs podName:672b955a-f3b1-44c3-8731-fb82f2e7662a nodeName:}" failed. No retries permitted until 2026-09-18 13:25:13.620305251 +0000 UTC m=+630.989564614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs") pod "maas-api-5b89985555-ls92w" (UID: "672b955a-f3b1-44c3-8731-fb82f2e7662a") : secret "maas-api-metrics-tls" not found
Sep 18 13:25:13.120860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.120844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672b955a-f3b1-44c3-8731-fb82f2e7662a-openshift-service-ca\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.122399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.122380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-maas-api-tls\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.130520 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.130501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9n5\" (UniqueName: \"kubernetes.io/projected/672b955a-f3b1-44c3-8731-fb82f2e7662a-kube-api-access-lc9n5\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.623700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.623668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.625926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.625905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs\") pod \"maas-api-5b89985555-ls92w\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") " pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.686025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.685993    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"]
Sep 18 13:25:13.690480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.690451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.693465 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.693445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 13:25:13.693723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.693709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j6nvk\""
Sep 18 13:25:13.708313 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.708284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"]
Sep 18 13:25:13.724541 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.724512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e4e976-1b11-4509-844e-e5ebc5455e82-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-6tc8t\" (UID: \"e1e4e976-1b11-4509-844e-e5ebc5455e82\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.724670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.724545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rmw\" (UniqueName: \"kubernetes.io/projected/e1e4e976-1b11-4509-844e-e5ebc5455e82-kube-api-access-87rmw\") pod \"payload-pre-processing-59fbc47bf8-6tc8t\" (UID: \"e1e4e976-1b11-4509-844e-e5ebc5455e82\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.757593 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.757562    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"]
Sep 18 13:25:13.761715 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.761692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:13.786188 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.786158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"]
Sep 18 13:25:13.825299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.825267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zzvq\" (UniqueName: \"kubernetes.io/projected/578343e7-ca05-4da6-a096-84e93dc0601c-kube-api-access-8zzvq\") pod \"payload-processing-5b54b7fbb7-hwhcb\" (UID: \"578343e7-ca05-4da6-a096-84e93dc0601c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:13.825478 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.825309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578343e7-ca05-4da6-a096-84e93dc0601c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-hwhcb\" (UID: \"578343e7-ca05-4da6-a096-84e93dc0601c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:13.825532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.825500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e4e976-1b11-4509-844e-e5ebc5455e82-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-6tc8t\" (UID: \"e1e4e976-1b11-4509-844e-e5ebc5455e82\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.825580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.825529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87rmw\" (UniqueName: \"kubernetes.io/projected/e1e4e976-1b11-4509-844e-e5ebc5455e82-kube-api-access-87rmw\") pod \"payload-pre-processing-59fbc47bf8-6tc8t\" (UID: \"e1e4e976-1b11-4509-844e-e5ebc5455e82\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.826253 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.826236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e4e976-1b11-4509-844e-e5ebc5455e82-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-6tc8t\" (UID: \"e1e4e976-1b11-4509-844e-e5ebc5455e82\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.856381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.856348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rmw\" (UniqueName: \"kubernetes.io/projected/e1e4e976-1b11-4509-844e-e5ebc5455e82-kube-api-access-87rmw\") pod \"payload-pre-processing-59fbc47bf8-6tc8t\" (UID: \"e1e4e976-1b11-4509-844e-e5ebc5455e82\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:13.856560 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.856524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:13.928176 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.928136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zzvq\" (UniqueName: \"kubernetes.io/projected/578343e7-ca05-4da6-a096-84e93dc0601c-kube-api-access-8zzvq\") pod \"payload-processing-5b54b7fbb7-hwhcb\" (UID: \"578343e7-ca05-4da6-a096-84e93dc0601c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:13.928718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.928683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578343e7-ca05-4da6-a096-84e93dc0601c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-hwhcb\" (UID: \"578343e7-ca05-4da6-a096-84e93dc0601c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:13.929664 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.929637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/578343e7-ca05-4da6-a096-84e93dc0601c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-hwhcb\" (UID: \"578343e7-ca05-4da6-a096-84e93dc0601c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:13.939023 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:13.938987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zzvq\" (UniqueName: \"kubernetes.io/projected/578343e7-ca05-4da6-a096-84e93dc0601c-kube-api-access-8zzvq\") pod \"payload-processing-5b54b7fbb7-hwhcb\" (UID: \"578343e7-ca05-4da6-a096-84e93dc0601c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:14.001602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.001572    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:14.076813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.076776    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:14.167844 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.167458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b89985555-ls92w"]
Sep 18 13:25:14.177444 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.171024    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:25:14.191260 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.191223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" event={"ID":"672b955a-f3b1-44c3-8731-fb82f2e7662a","Type":"ContainerStarted","Data":"9ec4e55b98f52a42d9907c54fa02b4343eaba0afc001938f4be35abdead1822f"}
Sep 18 13:25:14.308415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.308388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:14.322570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.322547    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"]
Sep 18 13:25:14.324840 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:25:14.324803    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e4e976_1b11_4509_844e_e5ebc5455e82.slice/crio-a6c139b63233a526c400489f4f9f4261c8e98a436de53e1b625224924dd59a89 WatchSource:0}: Error finding container a6c139b63233a526c400489f4f9f4261c8e98a436de53e1b625224924dd59a89: Status 404 returned error can't find the container with id a6c139b63233a526c400489f4f9f4261c8e98a436de53e1b625224924dd59a89
Sep 18 13:25:14.397751 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:14.397721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"]
Sep 18 13:25:14.399072 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:25:14.399041    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578343e7_ca05_4da6_a096_84e93dc0601c.slice/crio-103c14d3d56655f68635ebf02ca33e466550bbd82cc3797b86d0c42f15adcc33 WatchSource:0}: Error finding container 103c14d3d56655f68635ebf02ca33e466550bbd82cc3797b86d0c42f15adcc33: Status 404 returned error can't find the container with id 103c14d3d56655f68635ebf02ca33e466550bbd82cc3797b86d0c42f15adcc33
Sep 18 13:25:15.203277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:15.203168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb" event={"ID":"578343e7-ca05-4da6-a096-84e93dc0601c","Type":"ContainerStarted","Data":"103c14d3d56655f68635ebf02ca33e466550bbd82cc3797b86d0c42f15adcc33"}
Sep 18 13:25:15.206251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:15.206156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t" event={"ID":"e1e4e976-1b11-4509-844e-e5ebc5455e82","Type":"ContainerStarted","Data":"a6c139b63233a526c400489f4f9f4261c8e98a436de53e1b625224924dd59a89"}
Sep 18 13:25:17.218886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.218838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" event={"ID":"672b955a-f3b1-44c3-8731-fb82f2e7662a","Type":"ContainerStarted","Data":"c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577"}
Sep 18 13:25:17.219327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.218980    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:17.220518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.220493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb" event={"ID":"578343e7-ca05-4da6-a096-84e93dc0601c","Type":"ContainerStarted","Data":"247df99698fafeb36a091ea7ac2f67abc0fc98445e1e78f0f7ae1dcdcc105e0e"}
Sep 18 13:25:17.220626 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.220544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:17.221973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.221952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t" event={"ID":"e1e4e976-1b11-4509-844e-e5ebc5455e82","Type":"ContainerStarted","Data":"1827a1a89dc2f19de42423bdc28f01bfa9ec232ac0f0c1835fcbbfe581753e9d"}
Sep 18 13:25:17.222064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.222006    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:17.383632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.383575    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t" podStartSLOduration=2.129643768 podStartE2EDuration="4.383559075s" totalImagesPullingTime="2.253915307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:25:17.371696863 +0000 UTC m=+634.740956245" watchObservedRunningTime="2026-09-18 13:25:17.383559075 +0000 UTC m=+634.752818460"
Sep 18 13:25:17.384546 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.384515    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" podStartSLOduration=2.974940421 podStartE2EDuration="5.384504491s" totalImagesPullingTime="2.40956407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:25:17.261436017 +0000 UTC m=+634.630695400" watchObservedRunningTime="2026-09-18 13:25:17.384504491 +0000 UTC m=+634.753763874"
Sep 18 13:25:17.496771 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:17.496720    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb" podStartSLOduration=2.314092341 podStartE2EDuration="4.496697982s" totalImagesPullingTime="2.182605641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:25:17.496082688 +0000 UTC m=+634.865342071" watchObservedRunningTime="2026-09-18 13:25:17.496697982 +0000 UTC m=+634.865957364"
Sep 18 13:25:23.232367 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.232340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:25:23.255745 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.255718    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5cf78c8-ba21-482b-be8f-4270e3da8a18" containerID="cc65096317441d70f4a589828e8bdd308f70fcd93bdfdbf76156e8cf3fce5ec1" exitCode=0
Sep 18 13:25:23.255853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.255789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" event={"ID":"e5cf78c8-ba21-482b-be8f-4270e3da8a18","Type":"ContainerDied","Data":"cc65096317441d70f4a589828e8bdd308f70fcd93bdfdbf76156e8cf3fce5ec1"}
Sep 18 13:25:23.256079 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.256067    2564 scope.go:117] "RemoveContainer" containerID="cc65096317441d70f4a589828e8bdd308f70fcd93bdfdbf76156e8cf3fce5ec1"
Sep 18 13:25:23.257048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.257020    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:25:23.257122 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.257080    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:25:23.257122 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:23.257109    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:25:24.267770 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:24.267723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" event={"ID":"e5cf78c8-ba21-482b-be8f-4270e3da8a18","Type":"ContainerStarted","Data":"a3ed06d982d1f90600b447e78345481595f6cc6f54987fd50dd142b099a6c449"}
Sep 18 13:25:24.420528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:24.420493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:24.517251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:24.517215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:24.952000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:24.951967    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:25:24.953394 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:24.953365    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-knht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:25:24.953608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:24.953582    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" podUID="e5cf78c8-ba21-482b-be8f-4270e3da8a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 13:25:25.952627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:25.952582    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-knht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:25:25.953104 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:25.952654    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" podUID="e5cf78c8-ba21-482b-be8f-4270e3da8a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 13:25:26.951853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:26.951817    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-knht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:25:26.953426 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:26.952125    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" podUID="e5cf78c8-ba21-482b-be8f-4270e3da8a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 13:25:27.952937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:27.952481    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-knht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:25:27.952937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:27.952542    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" podUID="e5cf78c8-ba21-482b-be8f-4270e3da8a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 13:25:28.229877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:28.229785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t"
Sep 18 13:25:28.230264 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:28.230180    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-hwhcb"
Sep 18 13:25:28.731477 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:28.731447    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:25:28.953059 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:28.952625    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-knht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 13:25:28.953059 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:28.952689    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6" podUID="e5cf78c8-ba21-482b-be8f-4270e3da8a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 13:25:29.955860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:29.955833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:25:29.956897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:29.956876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6"
Sep 18 13:25:34.913382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.913347    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"]
Sep 18 13:25:34.918116 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.918099    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:34.921764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.921743    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 13:25:34.923008 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.922992    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fjbgv\""
Sep 18 13:25:34.923251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.923236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 18 13:25:34.954807 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.954785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"]
Sep 18 13:25:34.956240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.956219    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 13:25:34.967733 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:34.967706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:35.044881 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.044862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b22t2\" (UniqueName: \"kubernetes.io/projected/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-kube-api-access-b22t2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.044968 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.044909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.044968 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.044931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.045083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.045021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.045130 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.045077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.045177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.045133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146215 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b22t2\" (UniqueName: \"kubernetes.io/projected/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-kube-api-access-b22t2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146651 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.146789 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.146769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.148364 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.148347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.148624 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.148608    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.165893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.165842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b22t2\" (UniqueName: \"kubernetes.io/projected/6080f6fe-33e1-4457-a466-a9c01b4f5b6c-kube-api-access-b22t2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc\" (UID: \"6080f6fe-33e1-4457-a466-a9c01b4f5b6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.228351 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.228325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:35.560810 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:35.560781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"]
Sep 18 13:25:35.561888 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:25:35.561863    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6080f6fe_33e1_4457_a466_a9c01b4f5b6c.slice/crio-1abf209c34836554e11c7786dfbc9b43a4e2dbe3f93244676ffd2f6dc5dd7925 WatchSource:0}: Error finding container 1abf209c34836554e11c7786dfbc9b43a4e2dbe3f93244676ffd2f6dc5dd7925: Status 404 returned error can't find the container with id 1abf209c34836554e11c7786dfbc9b43a4e2dbe3f93244676ffd2f6dc5dd7925
Sep 18 13:25:36.343386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:36.343344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc" event={"ID":"6080f6fe-33e1-4457-a466-a9c01b4f5b6c","Type":"ContainerStarted","Data":"1abf209c34836554e11c7786dfbc9b43a4e2dbe3f93244676ffd2f6dc5dd7925"}
Sep 18 13:25:37.349740 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:37.349705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc" event={"ID":"6080f6fe-33e1-4457-a466-a9c01b4f5b6c","Type":"ContainerStarted","Data":"98dcebb2668657dcb66958f150477dc236dd0e7f196e773043b141534230166d"}
Sep 18 13:25:37.383282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:37.383235    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc" podStartSLOduration=2.166879685 podStartE2EDuration="3.38321697s" totalImagesPullingTime="1.216337285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:25:37.380776724 +0000 UTC m=+654.750036107" watchObservedRunningTime="2026-09-18 13:25:37.38321697 +0000 UTC m=+654.752476346"
Sep 18 13:25:45.228841 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:45.228806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:45.229279 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:45.228888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:45.241346 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:45.241327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:45.403364 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:45.403338    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc"
Sep 18 13:25:49.731360 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:49.731327    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:58.293011 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:58.292965    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:25:58.869961 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:25:58.869930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:17.322006 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.321974    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"]
Sep 18 13:26:17.326512 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.326484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.329933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.329908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 18 13:26:17.349344 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.349320    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"]
Sep 18 13:26:17.371933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.371904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.372068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.371960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6rq7\" (UniqueName: \"kubernetes.io/projected/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-kube-api-access-g6rq7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.372139 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.372064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.372139 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.372116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.372271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.372164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.372271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.372241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.420932 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.420903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:17.473136 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6rq7\" (UniqueName: \"kubernetes.io/projected/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-kube-api-access-g6rq7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473591 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473690 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.473733 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.473716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.475349 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.475332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.475625 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.475609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.482522 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.482497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6rq7\" (UniqueName: \"kubernetes.io/projected/f0b68510-f353-4fbc-aecc-3c4c5d24dd54-kube-api-access-g6rq7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m8wql\" (UID: \"f0b68510-f353-4fbc-aecc-3c4c5d24dd54\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.638998 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.638928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:17.910969 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:17.910939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"]
Sep 18 13:26:17.912300 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:26:17.912276    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b68510_f353_4fbc_aecc_3c4c5d24dd54.slice/crio-9ef343d418b9bc87cbfae78d4a5accfe82732898527d9d2baba4bc4cd3be5d7b WatchSource:0}: Error finding container 9ef343d418b9bc87cbfae78d4a5accfe82732898527d9d2baba4bc4cd3be5d7b: Status 404 returned error can't find the container with id 9ef343d418b9bc87cbfae78d4a5accfe82732898527d9d2baba4bc4cd3be5d7b
Sep 18 13:26:18.581484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:18.581445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql" event={"ID":"f0b68510-f353-4fbc-aecc-3c4c5d24dd54","Type":"ContainerStarted","Data":"c130dafb1cc2b64708707e763b7e1b3a75c0cdf0f40cc1c44cbce571a0fe68e8"}
Sep 18 13:26:18.581943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:18.581503    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql" event={"ID":"f0b68510-f353-4fbc-aecc-3c4c5d24dd54","Type":"ContainerStarted","Data":"9ef343d418b9bc87cbfae78d4a5accfe82732898527d9d2baba4bc4cd3be5d7b"}
Sep 18 13:26:18.606110 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:18.606064    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql" podStartSLOduration=1.413616633 podStartE2EDuration="1.606048213s" totalImagesPullingTime="192.43158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:26:18.60366561 +0000 UTC m=+695.972924992" watchObservedRunningTime="2026-09-18 13:26:18.606048213 +0000 UTC m=+695.975307594"
Sep 18 13:26:27.639302 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:27.639269    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:27.639676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:27.639326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:27.651609 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:27.651585    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:27.819605 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:27.819574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:27.887942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:27.887915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:28.649289 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:28.649263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m8wql"
Sep 18 13:26:34.244293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:34.244257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:43.807677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:43.807595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:46.226490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:46.226445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:53.766529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.766493    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"]
Sep 18 13:26:53.770216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.770183    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.772652 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.772632    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 18 13:26:53.782895 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.782870    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"]
Sep 18 13:26:53.798703 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.798667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:26:53.860143 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.860117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.860254 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.860154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.860254 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.860177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.860333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.860288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.860333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.860325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.860417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.860399    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554t9\" (UniqueName: \"kubernetes.io/projected/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-kube-api-access-554t9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.960892 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.960865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554t9\" (UniqueName: \"kubernetes.io/projected/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-kube-api-access-554t9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.960991 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.960921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.960991 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.960944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.960991 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.960966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.961134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.961011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.961134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.961039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.961391 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.961369    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.961462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.961415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.961462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.961441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.963113 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.963095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.963429 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.963410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:53.977562 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:53.977539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-554t9\" (UniqueName: \"kubernetes.io/projected/03d1e62d-3ee2-423b-a37a-59c9ec816dbb-kube-api-access-554t9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gjftl\" (UID: \"03d1e62d-3ee2-423b-a37a-59c9ec816dbb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:54.079799 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:54.079746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:26:54.349921 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:54.349896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"]
Sep 18 13:26:54.351510 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:26:54.351483    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03d1e62d_3ee2_423b_a37a_59c9ec816dbb.slice/crio-3f64f20d37c41c85ee20dba3b2f7d8547ed9d09a01ee153ab3fba76d36b431e3 WatchSource:0}: Error finding container 3f64f20d37c41c85ee20dba3b2f7d8547ed9d09a01ee153ab3fba76d36b431e3: Status 404 returned error can't find the container with id 3f64f20d37c41c85ee20dba3b2f7d8547ed9d09a01ee153ab3fba76d36b431e3
Sep 18 13:26:54.787666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:54.787624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl" event={"ID":"03d1e62d-3ee2-423b-a37a-59c9ec816dbb","Type":"ContainerStarted","Data":"1290a929099939473cae7bfc82b4bb24c8086ad913d3848dcee0c70a68f74ec4"}
Sep 18 13:26:54.787996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:54.787676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl" event={"ID":"03d1e62d-3ee2-423b-a37a-59c9ec816dbb","Type":"ContainerStarted","Data":"3f64f20d37c41c85ee20dba3b2f7d8547ed9d09a01ee153ab3fba76d36b431e3"}
Sep 18 13:26:54.805550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:26:54.805502    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl" podStartSLOduration=1.634282309 podStartE2EDuration="1.805486543s" totalImagesPullingTime="171.204234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:26:54.804357334 +0000 UTC m=+732.173616715" watchObservedRunningTime="2026-09-18 13:26:54.805486543 +0000 UTC m=+732.174745956"
Sep 18 13:27:04.080735 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:27:04.080699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:27:04.081090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:27:04.080748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:27:04.092895 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:27:04.092872    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:27:04.855286 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:27:04.855254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gjftl"
Sep 18 13:27:15.277478 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:27:15.277441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:27:15.355905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:27:15.355875    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:24.776494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.776466    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66c8bc4f9f-5cs45"]
Sep 18 13:28:24.779940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.779925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:24.835846 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.835826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c8bc4f9f-5cs45"]
Sep 18 13:28:24.875118 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.875067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cfd0207-bd58-44d2-ad03-d59a0448e6b6-tls-cert\") pod \"authorino-66c8bc4f9f-5cs45\" (UID: \"1cfd0207-bd58-44d2-ad03-d59a0448e6b6\") " pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:24.875269 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.875253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8mrh\" (UniqueName: \"kubernetes.io/projected/1cfd0207-bd58-44d2-ad03-d59a0448e6b6-kube-api-access-b8mrh\") pod \"authorino-66c8bc4f9f-5cs45\" (UID: \"1cfd0207-bd58-44d2-ad03-d59a0448e6b6\") " pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:24.975723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.975703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8mrh\" (UniqueName: \"kubernetes.io/projected/1cfd0207-bd58-44d2-ad03-d59a0448e6b6-kube-api-access-b8mrh\") pod \"authorino-66c8bc4f9f-5cs45\" (UID: \"1cfd0207-bd58-44d2-ad03-d59a0448e6b6\") " pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:24.975839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.975760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cfd0207-bd58-44d2-ad03-d59a0448e6b6-tls-cert\") pod \"authorino-66c8bc4f9f-5cs45\" (UID: \"1cfd0207-bd58-44d2-ad03-d59a0448e6b6\") " pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:24.978141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.978120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cfd0207-bd58-44d2-ad03-d59a0448e6b6-tls-cert\") pod \"authorino-66c8bc4f9f-5cs45\" (UID: \"1cfd0207-bd58-44d2-ad03-d59a0448e6b6\") " pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:24.984547 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:24.984528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8mrh\" (UniqueName: \"kubernetes.io/projected/1cfd0207-bd58-44d2-ad03-d59a0448e6b6-kube-api-access-b8mrh\") pod \"authorino-66c8bc4f9f-5cs45\" (UID: \"1cfd0207-bd58-44d2-ad03-d59a0448e6b6\") " pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:25.088348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:25.088300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c8bc4f9f-5cs45"
Sep 18 13:28:25.361541 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:25.361512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c8bc4f9f-5cs45"]
Sep 18 13:28:25.363464 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:25.363437    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cfd0207_bd58_44d2_ad03_d59a0448e6b6.slice/crio-7cad3230d0029aaa4ab774fb009d841bd025c903c3731ac9237e4dac952014ec WatchSource:0}: Error finding container 7cad3230d0029aaa4ab774fb009d841bd025c903c3731ac9237e4dac952014ec: Status 404 returned error can't find the container with id 7cad3230d0029aaa4ab774fb009d841bd025c903c3731ac9237e4dac952014ec
Sep 18 13:28:26.280168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.280133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c8bc4f9f-5cs45" event={"ID":"1cfd0207-bd58-44d2-ad03-d59a0448e6b6","Type":"ContainerStarted","Data":"fae8cf9e9fc2323caa0657a6a8f9b0e401e3d935b73772597360aeccaca35ee4"}
Sep 18 13:28:26.280649 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.280187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c8bc4f9f-5cs45" event={"ID":"1cfd0207-bd58-44d2-ad03-d59a0448e6b6","Type":"ContainerStarted","Data":"7cad3230d0029aaa4ab774fb009d841bd025c903c3731ac9237e4dac952014ec"}
Sep 18 13:28:26.299741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.299695    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66c8bc4f9f-5cs45" podStartSLOduration=1.5610694779999998 podStartE2EDuration="2.299681776s" totalImagesPullingTime="738.612298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:26.298282159 +0000 UTC m=+823.667541542" watchObservedRunningTime="2026-09-18 13:28:26.299681776 +0000 UTC m=+823.668941158"
Sep 18 13:28:26.329056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.329022    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65b9976c5d-gx8ps"]
Sep 18 13:28:26.329249 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.329208    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-65b9976c5d-gx8ps" podUID="39a40812-998e-435d-a4d5-8c9dd8f50b9d" containerName="authorino" containerID="cri-o://6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6" gracePeriod=30
Sep 18 13:28:26.591896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.591867    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:28:26.689014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.688927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whnm5\" (UniqueName: \"kubernetes.io/projected/39a40812-998e-435d-a4d5-8c9dd8f50b9d-kube-api-access-whnm5\") pod \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") "
Sep 18 13:28:26.689014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.688987    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39a40812-998e-435d-a4d5-8c9dd8f50b9d-tls-cert\") pod \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\" (UID: \"39a40812-998e-435d-a4d5-8c9dd8f50b9d\") "
Sep 18 13:28:26.691035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.691005    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a40812-998e-435d-a4d5-8c9dd8f50b9d-kube-api-access-whnm5" (OuterVolumeSpecName: "kube-api-access-whnm5") pod "39a40812-998e-435d-a4d5-8c9dd8f50b9d" (UID: "39a40812-998e-435d-a4d5-8c9dd8f50b9d"). InnerVolumeSpecName "kube-api-access-whnm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:28:26.701035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.701002    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39a40812-998e-435d-a4d5-8c9dd8f50b9d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "39a40812-998e-435d-a4d5-8c9dd8f50b9d" (UID: "39a40812-998e-435d-a4d5-8c9dd8f50b9d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:28:26.789668 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.789636    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whnm5\" (UniqueName: \"kubernetes.io/projected/39a40812-998e-435d-a4d5-8c9dd8f50b9d-kube-api-access-whnm5\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:28:26.789668 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.789663    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39a40812-998e-435d-a4d5-8c9dd8f50b9d-tls-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:28:26.971866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:26.971768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:27.082576 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.082538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:27.287658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.287626    2564 generic.go:356] "Generic (PLEG): container finished" podID="39a40812-998e-435d-a4d5-8c9dd8f50b9d" containerID="6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6" exitCode=0
Sep 18 13:28:27.288078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.287669    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b9976c5d-gx8ps"
Sep 18 13:28:27.288078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.287713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b9976c5d-gx8ps" event={"ID":"39a40812-998e-435d-a4d5-8c9dd8f50b9d","Type":"ContainerDied","Data":"6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6"}
Sep 18 13:28:27.288078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.287758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b9976c5d-gx8ps" event={"ID":"39a40812-998e-435d-a4d5-8c9dd8f50b9d","Type":"ContainerDied","Data":"6b7cc8b63cc8fcce7f27cf140398f0ec08c3ea126483675083fca953069eea6c"}
Sep 18 13:28:27.288078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.287781    2564 scope.go:117] "RemoveContainer" containerID="6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6"
Sep 18 13:28:27.297019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.297000    2564 scope.go:117] "RemoveContainer" containerID="6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6"
Sep 18 13:28:27.297361 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:28:27.297334    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6\": container with ID starting with 6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6 not found: ID does not exist" containerID="6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6"
Sep 18 13:28:27.297456 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.297361    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6"} err="failed to get container status \"6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6\": rpc error: code = NotFound desc = could not find container \"6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6\": container with ID starting with 6810d70c2e4d14c05e9dcb25014cab53c912e7f481b1931279afbd174d8dc7e6 not found: ID does not exist"
Sep 18 13:28:27.320401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.320367    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65b9976c5d-gx8ps"]
Sep 18 13:28:27.342394 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:27.342369    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65b9976c5d-gx8ps"]
Sep 18 13:28:28.213122 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:28.213069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:28.300114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:28.300081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:29.214836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:29.214803    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a40812-998e-435d-a4d5-8c9dd8f50b9d" path="/var/lib/kubelet/pods/39a40812-998e-435d-a4d5-8c9dd8f50b9d/volumes"
Sep 18 13:28:48.312070 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.312028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:48.413046 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.413009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:48.515622 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.515582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:48.724575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.724484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:48.770380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.770350    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"]
Sep 18 13:28:48.770785 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.770771    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a40812-998e-435d-a4d5-8c9dd8f50b9d" containerName="authorino"
Sep 18 13:28:48.770785 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.770786    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a40812-998e-435d-a4d5-8c9dd8f50b9d" containerName="authorino"
Sep 18 13:28:48.770877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.770853    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a40812-998e-435d-a4d5-8c9dd8f50b9d" containerName="authorino"
Sep 18 13:28:48.775076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.775056    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.778241 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.778224    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-5be8a3-openshift-default-dockercfg-8fx77\""
Sep 18 13:28:48.787155 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.787133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"]
Sep 18 13:28:48.834900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.834849    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:48.867525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-certs\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867659 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istiod-ca-cert\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867659 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgs9h\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-kube-api-access-vgs9h\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867659 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-data\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-token\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-credential-socket\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-podinfo\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-envoy\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.867901 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.867806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-socket\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.926866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.926836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:48.968816 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-socket\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.968929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-certs\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.968929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istiod-ca-cert\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.968929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgs9h\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-kube-api-access-vgs9h\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.968929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-data\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.968929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-token\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-credential-socket\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.968961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-podinfo\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.969005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-envoy\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.969226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-certs\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.969273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-socket\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.969326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-data\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969513 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.969434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-credential-socket\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.969597 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.969580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istiod-ca-cert\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.971342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.971322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-envoy\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.971523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.971501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-podinfo\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.986465 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.986435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-token\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:48.987921 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:48.987904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgs9h\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-kube-api-access-vgs9h\") pod \"e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") " pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:49.038613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.038572    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:49.086137 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.086113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:49.129502 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.129461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:49.399882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.399798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"]
Sep 18 13:28:49.404451 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:49.404423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648845bb_17b9_4d7d_b0a5_f3a50481de8b.slice/crio-cda768867d4f9e7d2ee641ff8f40f21f747f49b3801cad20ee715d3828a3b087 WatchSource:0}: Error finding container cda768867d4f9e7d2ee641ff8f40f21f747f49b3801cad20ee715d3828a3b087: Status 404 returned error can't find the container with id cda768867d4f9e7d2ee641ff8f40f21f747f49b3801cad20ee715d3828a3b087
Sep 18 13:28:49.406534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.406498    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:28:49.406606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.406569    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:28:49.406606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.406601    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:28:49.419899 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:49.419872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" event={"ID":"648845bb-17b9-4d7d-b0a5-f3a50481de8b","Type":"ContainerStarted","Data":"cda768867d4f9e7d2ee641ff8f40f21f747f49b3801cad20ee715d3828a3b087"}
Sep 18 13:28:50.006270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.006233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:50.120621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.120590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:50.427281 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.427176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" event={"ID":"648845bb-17b9-4d7d-b0a5-f3a50481de8b","Type":"ContainerStarted","Data":"aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"}
Sep 18 13:28:50.456917 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.456877    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podStartSLOduration=2.456863059 podStartE2EDuration="2.456863059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:50.455756706 +0000 UTC m=+847.825016088" watchObservedRunningTime="2026-09-18 13:28:50.456863059 +0000 UTC m=+847.826122441"
Sep 18 13:28:50.505950 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.505919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:50.607781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.607759    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7478-7c78b9"]
Sep 18 13:28:50.611343 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.611320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:50.617437 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.617415    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncnrt\""
Sep 18 13:28:50.625227 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.625180    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7478-7c78b9"]
Sep 18 13:28:50.685591 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.685530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59nc\" (UniqueName: \"kubernetes.io/projected/535cbe0b-8f1a-421a-9d02-14f360e7a7bb-kube-api-access-m59nc\") pod \"test-curl-7478-7c78b9\" (UID: \"535cbe0b-8f1a-421a-9d02-14f360e7a7bb\") " pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:50.785900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.785876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59nc\" (UniqueName: \"kubernetes.io/projected/535cbe0b-8f1a-421a-9d02-14f360e7a7bb-kube-api-access-m59nc\") pod \"test-curl-7478-7c78b9\" (UID: \"535cbe0b-8f1a-421a-9d02-14f360e7a7bb\") " pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:50.806725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.806695    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59nc\" (UniqueName: \"kubernetes.io/projected/535cbe0b-8f1a-421a-9d02-14f360e7a7bb-kube-api-access-m59nc\") pod \"test-curl-7478-7c78b9\" (UID: \"535cbe0b-8f1a-421a-9d02-14f360e7a7bb\") " pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:50.921189 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:50.921167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:51.087043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:51.087014    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:51.091692 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:51.091668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:51.192748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:51.192713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7478-7c78b9"]
Sep 18 13:28:51.194113 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:51.194089    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod535cbe0b_8f1a_421a_9d02_14f360e7a7bb.slice/crio-e3e60dcee347b79f1c5e514c0c31c268d435bc0e9f9a14d75ffc138c7c54bdf5 WatchSource:0}: Error finding container e3e60dcee347b79f1c5e514c0c31c268d435bc0e9f9a14d75ffc138c7c54bdf5: Status 404 returned error can't find the container with id e3e60dcee347b79f1c5e514c0c31c268d435bc0e9f9a14d75ffc138c7c54bdf5
Sep 18 13:28:51.434248 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:51.434216    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7478-7c78b9" event={"ID":"535cbe0b-8f1a-421a-9d02-14f360e7a7bb","Type":"ContainerStarted","Data":"e3e60dcee347b79f1c5e514c0c31c268d435bc0e9f9a14d75ffc138c7c54bdf5"}
Sep 18 13:28:51.434724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:51.434467    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:51.435278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:51.435261    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:28:52.343063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:52.343024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:52.510973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:52.510937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:52.763030 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:52.762986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:52.896235 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:52.896146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:53.457844 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.457806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7478-7c78b9" event={"ID":"535cbe0b-8f1a-421a-9d02-14f360e7a7bb","Type":"ContainerStarted","Data":"328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07"}
Sep 18 13:28:53.478943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.478890    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7478-7c78b9" podStartSLOduration=1.368137585 podStartE2EDuration="3.478870373s" totalImagesPullingTime="2.110732788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:53.476597225 +0000 UTC m=+850.845856608" watchObservedRunningTime="2026-09-18 13:28:53.478870373 +0000 UTC m=+850.848129758"
Sep 18 13:28:53.540230 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.540183    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"]
Sep 18 13:28:53.543938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.543918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.546871 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.546846    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-34aeca-serving-cert\""
Sep 18 13:28:53.561656 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.561597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"]
Sep 18 13:28:53.609722 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.609676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:53.613713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.613690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-maas-api-tls\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.613829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.613722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-metrics-certs\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.613829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.613806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8b8w\" (UniqueName: \"kubernetes.io/projected/056a999d-76c5-4984-b1fb-75ea5fbb62e0-kube-api-access-j8b8w\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.613943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.613861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/056a999d-76c5-4984-b1fb-75ea5fbb62e0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.701339 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.701302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:53.715100 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.715060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-maas-api-tls\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.715251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.715116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-metrics-certs\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.715679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.715424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8b8w\" (UniqueName: \"kubernetes.io/projected/056a999d-76c5-4984-b1fb-75ea5fbb62e0-kube-api-access-j8b8w\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.715679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.715485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/056a999d-76c5-4984-b1fb-75ea5fbb62e0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.716306 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.716281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/056a999d-76c5-4984-b1fb-75ea5fbb62e0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.718738 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.718274    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-metrics-certs\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.718738 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.718698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-maas-api-tls\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.726506 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.726481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8b8w\" (UniqueName: \"kubernetes.io/projected/056a999d-76c5-4984-b1fb-75ea5fbb62e0-kube-api-access-j8b8w\") pod \"maas-api-e2e-inf-a-34aeca-59f46499d-88jrz\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:53.801868 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.801839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:53.855518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:53.855460    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:54.139678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.139609    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7478-7c78b9"]
Sep 18 13:28:54.146504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.146476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"]
Sep 18 13:28:54.148833 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:54.148804    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056a999d_76c5_4984_b1fb_75ea5fbb62e0.slice/crio-00cb9c15e08b106d2e871da362e31b0532cd1a97aceea24b8491cbd9893a140a WatchSource:0}: Error finding container 00cb9c15e08b106d2e871da362e31b0532cd1a97aceea24b8491cbd9893a140a: Status 404 returned error can't find the container with id 00cb9c15e08b106d2e871da362e31b0532cd1a97aceea24b8491cbd9893a140a
Sep 18 13:28:54.149794 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.149773    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7478-7c78b9"]
Sep 18 13:28:54.220292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.220251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:54.298186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.298152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:54.422648 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.422584    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"]
Sep 18 13:28:54.423001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.422989    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" containerName="test-curl-7478-7c78b9"
Sep 18 13:28:54.423047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.423003    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" containerName="test-curl-7478-7c78b9"
Sep 18 13:28:54.423086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.423070    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" containerName="test-curl-7478-7c78b9"
Sep 18 13:28:54.427554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.427537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.431296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.431273    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-34aeca-dockercfg-8rfp7\""
Sep 18 13:28:54.431584 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.431568    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-34aeca\""
Sep 18 13:28:54.439402 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.439381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"]
Sep 18 13:28:54.467105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.467067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz" event={"ID":"056a999d-76c5-4984-b1fb-75ea5fbb62e0","Type":"ContainerStarted","Data":"00cb9c15e08b106d2e871da362e31b0532cd1a97aceea24b8491cbd9893a140a"}
Sep 18 13:28:54.467338 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:28:54.467323    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7478-7c78b9" container="test-curl-7478-7c78b9"
Sep 18 13:28:54.522709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.522682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29096b2e-34e3-468f-a65f-2d6716e99c35-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.522855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.522747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ksf\" (UniqueName: \"kubernetes.io/projected/29096b2e-34e3-468f-a65f-2d6716e99c35-kube-api-access-c9ksf\") pod \"payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.623411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.623383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29096b2e-34e3-468f-a65f-2d6716e99c35-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.623822 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.623436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ksf\" (UniqueName: \"kubernetes.io/projected/29096b2e-34e3-468f-a65f-2d6716e99c35-kube-api-access-c9ksf\") pod \"payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.624177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.624154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29096b2e-34e3-468f-a65f-2d6716e99c35-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.641137 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.641113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ksf\" (UniqueName: \"kubernetes.io/projected/29096b2e-34e3-468f-a65f-2d6716e99c35-kube-api-access-c9ksf\") pod \"payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.680853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.680826    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"]
Sep 18 13:28:54.686420 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.686337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.689550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.689530    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-951469-serving-cert\""
Sep 18 13:28:54.695002 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.694525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"]
Sep 18 13:28:54.737322 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.737298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:54.741042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.741023    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:54.825323 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.825288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-maas-api-tls\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.825470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.825362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw5gr\" (UniqueName: \"kubernetes.io/projected/adb7123c-54ca-46d8-9010-69323e6a5fad-kube-api-access-bw5gr\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.825470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.825426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-metrics-certs\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.825601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.825483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb7123c-54ca-46d8-9010-69323e6a5fad-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.834182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.834153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:54.926229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.926147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-maas-api-tls\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.926229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.926210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw5gr\" (UniqueName: \"kubernetes.io/projected/adb7123c-54ca-46d8-9010-69323e6a5fad-kube-api-access-bw5gr\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.926418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.926268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-metrics-certs\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.926418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.926324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb7123c-54ca-46d8-9010-69323e6a5fad-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.926933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.926912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb7123c-54ca-46d8-9010-69323e6a5fad-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.928466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.928448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-metrics-certs\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.928543 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.928528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-maas-api-tls\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:54.934217 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.934164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:54.934626 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:54.934609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw5gr\" (UniqueName: \"kubernetes.io/projected/adb7123c-54ca-46d8-9010-69323e6a5fad-kube-api-access-bw5gr\") pod \"maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:55.022014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.021993    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:55.025762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.025736    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"]
Sep 18 13:28:55.026735 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:55.026711    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29096b2e_34e3_468f_a65f_2d6716e99c35.slice/crio-15ff35a336fd0165cc81d936607681335466a5389d79cf172872bb1f12b97a65 WatchSource:0}: Error finding container 15ff35a336fd0165cc81d936607681335466a5389d79cf172872bb1f12b97a65: Status 404 returned error can't find the container with id 15ff35a336fd0165cc81d936607681335466a5389d79cf172872bb1f12b97a65
Sep 18 13:28:55.300239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.300212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"]
Sep 18 13:28:55.302423 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:55.302398    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb7123c_54ca_46d8_9010_69323e6a5fad.slice/crio-1f919e21a9f1216909d66291527f403164491ddda00c6e443e3381e6d9fcee56 WatchSource:0}: Error finding container 1f919e21a9f1216909d66291527f403164491ddda00c6e443e3381e6d9fcee56: Status 404 returned error can't find the container with id 1f919e21a9f1216909d66291527f403164491ddda00c6e443e3381e6d9fcee56
Sep 18 13:28:55.475833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.475798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz" event={"ID":"056a999d-76c5-4984-b1fb-75ea5fbb62e0","Type":"ContainerStarted","Data":"d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2"}
Sep 18 13:28:55.475997 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.475978    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:28:55.477583 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.477556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd" event={"ID":"29096b2e-34e3-468f-a65f-2d6716e99c35","Type":"ContainerStarted","Data":"dd7007c87a58068f7de851ad830221bf62624d0f99b4ad8569a797c0cf191585"}
Sep 18 13:28:55.477786 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.477596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd" event={"ID":"29096b2e-34e3-468f-a65f-2d6716e99c35","Type":"ContainerStarted","Data":"15ff35a336fd0165cc81d936607681335466a5389d79cf172872bb1f12b97a65"}
Sep 18 13:28:55.477786 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.477622    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:28:55.479069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.479045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7" event={"ID":"adb7123c-54ca-46d8-9010-69323e6a5fad","Type":"ContainerStarted","Data":"1f919e21a9f1216909d66291527f403164491ddda00c6e443e3381e6d9fcee56"}
Sep 18 13:28:55.479185 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.479072    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7478-7c78b9" podUID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" containerName="test-curl-7478-7c78b9" containerID="cri-o://328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07" gracePeriod=2
Sep 18 13:28:55.510068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.510025    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz" podStartSLOduration=2.000986433 podStartE2EDuration="2.510012206s" totalImagesPullingTime="509.025773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:55.506560117 +0000 UTC m=+852.875819499" watchObservedRunningTime="2026-09-18 13:28:55.510012206 +0000 UTC m=+852.879271639"
Sep 18 13:28:55.532316 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.532227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:55.544860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.544804    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd" podStartSLOduration=1.544786927 podStartE2EDuration="1.544786927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:55.539330426 +0000 UTC m=+852.908589808" watchObservedRunningTime="2026-09-18 13:28:55.544786927 +0000 UTC m=+852.914046311"
Sep 18 13:28:55.729466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:55.729428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:56.108035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.107997    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"]
Sep 18 13:28:56.112814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.112781    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.115633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.115613    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-5be8a3-serving-cert\""
Sep 18 13:28:56.125945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.125923    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"]
Sep 18 13:28:56.180278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.180250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:56.238151 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.238125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b3a975-d653-4f3e-93a0-2eece42baa66-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.238293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.238165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-metrics-certs\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.238293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.238244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.238389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.238317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjqhp\" (UniqueName: \"kubernetes.io/projected/58b3a975-d653-4f3e-93a0-2eece42baa66-kube-api-access-xjqhp\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.280310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.280275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:56.339307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.339281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjqhp\" (UniqueName: \"kubernetes.io/projected/58b3a975-d653-4f3e-93a0-2eece42baa66-kube-api-access-xjqhp\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.339393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.339347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b3a975-d653-4f3e-93a0-2eece42baa66-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.339393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.339373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-metrics-certs\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.339510 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.339405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.339510 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:28:56.339498    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-serving-cert: secret "maas-api-e2e-worker-w5-5be8a3-serving-cert" not found
Sep 18 13:28:56.339606 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:28:56.339546    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls podName:58b3a975-d653-4f3e-93a0-2eece42baa66 nodeName:}" failed. No retries permitted until 2026-09-18 13:28:56.839532869 +0000 UTC m=+854.208792228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls") pod "maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" (UID: "58b3a975-d653-4f3e-93a0-2eece42baa66") : secret "maas-api-e2e-worker-w5-5be8a3-serving-cert" not found
Sep 18 13:28:56.340051 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.340030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b3a975-d653-4f3e-93a0-2eece42baa66-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.341780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.341761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-metrics-certs\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.348056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.348034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjqhp\" (UniqueName: \"kubernetes.io/projected/58b3a975-d653-4f3e-93a0-2eece42baa66-kube-api-access-xjqhp\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.486705 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.486677    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7" event={"ID":"adb7123c-54ca-46d8-9010-69323e6a5fad","Type":"ContainerStarted","Data":"43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3"}
Sep 18 13:28:56.487187 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.486948    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:28:56.506356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.506315    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7" podStartSLOduration=2.183674632 podStartE2EDuration="2.506301893s" totalImagesPullingTime="322.627261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:56.505662044 +0000 UTC m=+853.874921420" watchObservedRunningTime="2026-09-18 13:28:56.506301893 +0000 UTC m=+853.875561275"
Sep 18 13:28:56.600242 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.600188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:56.699514 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.699475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:56.777009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.776933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:56.843453 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.843426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:56.845634 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:56.845614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls\") pod \"maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:57.024901 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.024866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:57.207850 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.207817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:57.302463 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.302439    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"]
Sep 18 13:28:57.303210 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:28:57.303171    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b3a975_d653_4f3e_93a0_2eece42baa66.slice/crio-7c58f2dcf711ea0b4bde8fda48d0762a871f677e2d2a3c29e1141e97d17fc015 WatchSource:0}: Error finding container 7c58f2dcf711ea0b4bde8fda48d0762a871f677e2d2a3c29e1141e97d17fc015: Status 404 returned error can't find the container with id 7c58f2dcf711ea0b4bde8fda48d0762a871f677e2d2a3c29e1141e97d17fc015
Sep 18 13:28:57.495606 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.495584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" event={"ID":"58b3a975-d653-4f3e-93a0-2eece42baa66","Type":"ContainerStarted","Data":"7c58f2dcf711ea0b4bde8fda48d0762a871f677e2d2a3c29e1141e97d17fc015"}
Sep 18 13:28:57.568952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.568865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:57.663528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.663501    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:57.672914 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.672866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:57.753127 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.753104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m59nc\" (UniqueName: \"kubernetes.io/projected/535cbe0b-8f1a-421a-9d02-14f360e7a7bb-kube-api-access-m59nc\") pod \"535cbe0b-8f1a-421a-9d02-14f360e7a7bb\" (UID: \"535cbe0b-8f1a-421a-9d02-14f360e7a7bb\") "
Sep 18 13:28:57.755063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.755032    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/535cbe0b-8f1a-421a-9d02-14f360e7a7bb-kube-api-access-m59nc" (OuterVolumeSpecName: "kube-api-access-m59nc") pod "535cbe0b-8f1a-421a-9d02-14f360e7a7bb" (UID: "535cbe0b-8f1a-421a-9d02-14f360e7a7bb"). InnerVolumeSpecName "kube-api-access-m59nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:28:57.854038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.853977    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m59nc\" (UniqueName: \"kubernetes.io/projected/535cbe0b-8f1a-421a-9d02-14f360e7a7bb-kube-api-access-m59nc\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:28:57.865050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:57.865010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:58.199395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.199315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:58.269660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.269621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:58.374393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.374368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:58.503418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.503383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" event={"ID":"58b3a975-d653-4f3e-93a0-2eece42baa66","Type":"ContainerStarted","Data":"a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a"}
Sep 18 13:28:58.503565 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.503549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:28:58.504731 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.504702    2564 generic.go:356] "Generic (PLEG): container finished" podID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" containerID="328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07" exitCode=137
Sep 18 13:28:58.504826 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.504746    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:58.504826 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.504806    2564 scope.go:117] "RemoveContainer" containerID="328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07"
Sep 18 13:28:58.514166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.514149    2564 scope.go:117] "RemoveContainer" containerID="328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07"
Sep 18 13:28:58.514475 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:28:58.514458    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07\": container with ID starting with 328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07 not found: ID does not exist" containerID="328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07"
Sep 18 13:28:58.514534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.514483    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07"} err="failed to get container status \"328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07\": rpc error: code = NotFound desc = could not find container \"328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07\": container with ID starting with 328b56e2267000e341429deb2c18d51c54dca27932b4d2b84b333b6a66073b07 not found: ID does not exist"
Sep 18 13:28:58.532539 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:28:58.532515    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7478-7c78b9\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" pod="opendatahub/test-curl-7478-7c78b9"
Sep 18 13:28:58.533048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:58.533011    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" podStartSLOduration=2.127478936 podStartE2EDuration="2.532998206s" totalImagesPullingTime="405.51927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:28:58.53029052 +0000 UTC m=+855.899549902" watchObservedRunningTime="2026-09-18 13:28:58.532998206 +0000 UTC m=+855.902257589"
Sep 18 13:28:59.198280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:59.198245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:28:59.215014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:28:59.214976    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="535cbe0b-8f1a-421a-9d02-14f360e7a7bb" path="/var/lib/kubelet/pods/535cbe0b-8f1a-421a-9d02-14f360e7a7bb/volumes"
Sep 18 13:29:00.177522 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:00.177489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:00.738250 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:00.738212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:00.886869 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:00.886818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:01.228259 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:01.228155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:01.336612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:01.336573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:01.495646 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:01.495612    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:29:01.910265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:01.910152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:02.501174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:02.501146    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:29:03.078527 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:03.078493    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:04.442166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:04.442131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:04.518209 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:04.518168    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:29:04.599307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:04.599273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:05.631725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.629432    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"]
Sep 18 13:29:05.635445 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.635420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.638118 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.638096    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a304aa20-serving-cert\""
Sep 18 13:29:05.679082 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.679049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:05.685642 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.682446    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"]
Sep 18 13:29:05.730412 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.730381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e579bd3b-5176-4b9d-97a1-7585218ec0a9-openshift-service-ca\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.730521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.730421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-metrics-certs\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.730521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.730447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.730618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.730521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npdx9\" (UniqueName: \"kubernetes.io/projected/e579bd3b-5176-4b9d-97a1-7585218ec0a9-kube-api-access-npdx9\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.775696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.775669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:05.831065 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.831038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e579bd3b-5176-4b9d-97a1-7585218ec0a9-openshift-service-ca\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.831214 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.831080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-metrics-certs\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.831214 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.831116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.831214 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.831147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npdx9\" (UniqueName: \"kubernetes.io/projected/e579bd3b-5176-4b9d-97a1-7585218ec0a9-kube-api-access-npdx9\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.831344 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:29:05.831278    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-serving-cert: secret "maas-api-e2e-ait-a304aa20-serving-cert" not found
Sep 18 13:29:05.831399 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:29:05.831387    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls podName:e579bd3b-5176-4b9d-97a1-7585218ec0a9 nodeName:}" failed. No retries permitted until 2026-09-18 13:29:06.331368254 +0000 UTC m=+863.700627618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls") pod "maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" (UID: "e579bd3b-5176-4b9d-97a1-7585218ec0a9") : secret "maas-api-e2e-ait-a304aa20-serving-cert" not found
Sep 18 13:29:05.831698 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.831671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e579bd3b-5176-4b9d-97a1-7585218ec0a9-openshift-service-ca\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.833554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.833532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-metrics-certs\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.842749 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.842729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npdx9\" (UniqueName: \"kubernetes.io/projected/e579bd3b-5176-4b9d-97a1-7585218ec0a9-kube-api-access-npdx9\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:05.953889 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:05.953800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:06.337823 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.337610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:06.339946 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.339919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls\") pod \"maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:06.467079 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.467038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:06.489184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.489114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:29:06.578848 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.578751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:06.598666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.598582    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:06.900664 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.900636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"]
Sep 18 13:29:06.901577 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:29:06.901552    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode579bd3b_5176_4b9d_97a1_7585218ec0a9.slice/crio-1a4606e0984d0096db9e0c68d8e4dcd2df0f9b1fcf4719d9155ddacb111aea24 WatchSource:0}: Error finding container 1a4606e0984d0096db9e0c68d8e4dcd2df0f9b1fcf4719d9155ddacb111aea24: Status 404 returned error can't find the container with id 1a4606e0984d0096db9e0c68d8e4dcd2df0f9b1fcf4719d9155ddacb111aea24
Sep 18 13:29:06.972687 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:06.972636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:07.074133 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.074100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:07.339529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.339499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:07.442173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.442139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:07.559464 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.559425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:07.578785 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.578752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" event={"ID":"e579bd3b-5176-4b9d-97a1-7585218ec0a9","Type":"ContainerStarted","Data":"fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0"}
Sep 18 13:29:07.578952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.578802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" event={"ID":"e579bd3b-5176-4b9d-97a1-7585218ec0a9","Type":"ContainerStarted","Data":"1a4606e0984d0096db9e0c68d8e4dcd2df0f9b1fcf4719d9155ddacb111aea24"}
Sep 18 13:29:07.578952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.578838    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:07.606259 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.606211    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" podStartSLOduration=2.287933636 podStartE2EDuration="2.606176192s" totalImagesPullingTime="318.242556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:29:07.604165974 +0000 UTC m=+864.973425356" watchObservedRunningTime="2026-09-18 13:29:07.606176192 +0000 UTC m=+864.975435574"
Sep 18 13:29:07.665099 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.665062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:07.821385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:07.821116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:08.066908 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:08.066874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:08.252391 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:08.252361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:08.406945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:08.406912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:08.562995 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:08.562899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:08.766014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:08.765974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:08.916352 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:08.916268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:09.019684 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.019649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:09.508942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.508909    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"]
Sep 18 13:29:09.512877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.512858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.516572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.516510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-b7292e-serving-cert\""
Sep 18 13:29:09.531452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.531428    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"]
Sep 18 13:29:09.567249 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.567217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:09.665521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.665483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:09.681599 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.681562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5xwh\" (UniqueName: \"kubernetes.io/projected/fbca19b6-0534-42fa-afe5-6f03159493e2-kube-api-access-x5xwh\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.681599 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.681592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-maas-api-tls\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.681815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.681637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbca19b6-0534-42fa-afe5-6f03159493e2-openshift-service-ca\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.681815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.681735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-metrics-certs\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.782524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.782447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xwh\" (UniqueName: \"kubernetes.io/projected/fbca19b6-0534-42fa-afe5-6f03159493e2-kube-api-access-x5xwh\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.782524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.782482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-maas-api-tls\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.782697 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.782604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbca19b6-0534-42fa-afe5-6f03159493e2-openshift-service-ca\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.782697 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.782677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-metrics-certs\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.783420 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.783398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbca19b6-0534-42fa-afe5-6f03159493e2-openshift-service-ca\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.785188 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.785167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-maas-api-tls\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.785523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.785499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-metrics-certs\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.792701 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.792674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5xwh\" (UniqueName: \"kubernetes.io/projected/fbca19b6-0534-42fa-afe5-6f03159493e2-kube-api-access-x5xwh\") pod \"maas-api-e2e-autores-b7292e-699bf5954b-rjdhn\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.824963 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.824946    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:09.834434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:09.834403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:10.118924 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.118892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"]
Sep 18 13:29:10.119234 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:29:10.119185    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbca19b6_0534_42fa_afe5_6f03159493e2.slice/crio-3e1aef2f838befe5d4d6824bc3b1c0d35f106f6052d286252a8dfd3f023c8ce7 WatchSource:0}: Error finding container 3e1aef2f838befe5d4d6824bc3b1c0d35f106f6052d286252a8dfd3f023c8ce7: Status 404 returned error can't find the container with id 3e1aef2f838befe5d4d6824bc3b1c0d35f106f6052d286252a8dfd3f023c8ce7
Sep 18 13:29:10.170522 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.170490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:10.273762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.273723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:10.601386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.601342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn" event={"ID":"fbca19b6-0534-42fa-afe5-6f03159493e2","Type":"ContainerStarted","Data":"c5489ca787f8cd1f10f2d23eb67e48e55a5a35c1bd620f97fd56193b44387b64"}
Sep 18 13:29:10.601840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.601452    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:10.601840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.601478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn" event={"ID":"fbca19b6-0534-42fa-afe5-6f03159493e2","Type":"ContainerStarted","Data":"3e1aef2f838befe5d4d6824bc3b1c0d35f106f6052d286252a8dfd3f023c8ce7"}
Sep 18 13:29:10.624416 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.624370    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn" podStartSLOduration=1.313648143 podStartE2EDuration="1.624354255s" totalImagesPullingTime="310.706112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:29:10.621768135 +0000 UTC m=+867.991027518" watchObservedRunningTime="2026-09-18 13:29:10.624354255 +0000 UTC m=+867.993613634"
Sep 18 13:29:10.939891 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:10.939852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:11.314951 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.314890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:11.510184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.510141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:11.608979 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.608910    2564 generic.go:356] "Generic (PLEG): container finished" podID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerID="aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556" exitCode=0
Sep 18 13:29:11.609344 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.608990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" event={"ID":"648845bb-17b9-4d7d-b0a5-f3a50481de8b","Type":"ContainerDied","Data":"aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"}
Sep 18 13:29:11.609477 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.609461    2564 scope.go:117] "RemoveContainer" containerID="aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"
Sep 18 13:29:11.610525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.610486    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:29:11.610628 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.610565    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:29:11.610628 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:11.610617    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 13:29:12.078084 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:12.078038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:12.617159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:12.617128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" event={"ID":"648845bb-17b9-4d7d-b0a5-f3a50481de8b","Type":"ContainerStarted","Data":"f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0"}
Sep 18 13:29:13.087249 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:13.087217    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:29:13.087421 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:13.087383    2564 patch_prober.go:28] interesting pod/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 18 13:29:13.087466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:13.087438    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 18 13:29:13.340478 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:13.340395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:13.591052 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:13.590981    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:14.087141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:14.087108    2564 patch_prober.go:28] interesting pod/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 18 13:29:14.087523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:14.087160    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 18 13:29:14.336129 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:14.336087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:14.545100 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:14.545060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:14.711129 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:14.711095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:15.086863 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:15.086828    2564 patch_prober.go:28] interesting pod/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 18 13:29:15.087030 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:15.086881    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 18 13:29:15.154042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:15.154003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:16.086963 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:16.086924    2564 patch_prober.go:28] interesting pod/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 18 13:29:16.087239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:16.086986    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 18 13:29:16.141221 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:16.141174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:16.614500 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:16.614470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:29:17.034939 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.034901    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"]
Sep 18 13:29:17.040908 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.040883    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.044291 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.044185    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-021eb8-serving-cert\""
Sep 18 13:29:17.052452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.052416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6skx\" (UniqueName: \"kubernetes.io/projected/8968a30d-7df4-4cd6-af24-fe325f607aa3-kube-api-access-w6skx\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.052586 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.052498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8968a30d-7df4-4cd6-af24-fe325f607aa3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.052586 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.052582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.052730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.052618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-metrics-certs\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.076094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.076069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"]
Sep 18 13:29:17.086751 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.086722    2564 patch_prober.go:28] interesting pod/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 18 13:29:17.086854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.086816    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 18 13:29:17.156213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.154707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.156213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.154777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-metrics-certs\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.156213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.154849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6skx\" (UniqueName: \"kubernetes.io/projected/8968a30d-7df4-4cd6-af24-fe325f607aa3-kube-api-access-w6skx\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.156213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.154910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8968a30d-7df4-4cd6-af24-fe325f607aa3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.156213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.155707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8968a30d-7df4-4cd6-af24-fe325f607aa3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.156213 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:29:17.156169    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-serving-cert: secret "maas-api-e2e-inf-b-021eb8-serving-cert" not found
Sep 18 13:29:17.156642 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:29:17.156258    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls podName:8968a30d-7df4-4cd6-af24-fe325f607aa3 nodeName:}" failed. No retries permitted until 2026-09-18 13:29:17.656238591 +0000 UTC m=+875.025497955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls") pod "maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" (UID: "8968a30d-7df4-4cd6-af24-fe325f607aa3") : secret "maas-api-e2e-inf-b-021eb8-serving-cert" not found
Sep 18 13:29:17.168214 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.159558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-metrics-certs\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.218544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.218517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6skx\" (UniqueName: \"kubernetes.io/projected/8968a30d-7df4-4cd6-af24-fe325f607aa3-kube-api-access-w6skx\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.220670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.220586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:17.541963 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.541930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:17.664069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.664040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.666412 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.666391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls\") pod \"maas-api-e2e-inf-b-021eb8-fcf6d6486-896th\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:17.720392 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.720357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:17.959287 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:17.959217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:18.090475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.090444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:29:18.090809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.090790    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:29:18.091487 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.091467    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:29:18.162479 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.162459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:18.242096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.242066    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"]
Sep 18 13:29:18.243043 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:29:18.243020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8968a30d_7df4_4cd6_af24_fe325f607aa3.slice/crio-6b5568af254783683fd6fb7e2eda8aad8c6b0d1cc7063c45ee1a4c138d60f8dc WatchSource:0}: Error finding container 6b5568af254783683fd6fb7e2eda8aad8c6b0d1cc7063c45ee1a4c138d60f8dc: Status 404 returned error can't find the container with id 6b5568af254783683fd6fb7e2eda8aad8c6b0d1cc7063c45ee1a4c138d60f8dc
Sep 18 13:29:18.266655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.266623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:18.657940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.657913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" event={"ID":"8968a30d-7df4-4cd6-af24-fe325f607aa3","Type":"ContainerStarted","Data":"6b5568af254783683fd6fb7e2eda8aad8c6b0d1cc7063c45ee1a4c138d60f8dc"}
Sep 18 13:29:18.887295 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:18.887214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:19.665523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:19.665482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" event={"ID":"8968a30d-7df4-4cd6-af24-fe325f607aa3","Type":"ContainerStarted","Data":"90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950"}
Sep 18 13:29:19.690612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:19.690568    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" podStartSLOduration=3.310816249 podStartE2EDuration="3.690547791s" totalImagesPullingTime="379.731542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:29:19.68969437 +0000 UTC m=+877.058953751" watchObservedRunningTime="2026-09-18 13:29:19.690547791 +0000 UTC m=+877.059807173"
Sep 18 13:29:20.301260 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:20.301226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:20.671872 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:20.671849    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:21.405630 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:21.405591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:22.381990 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:22.381961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:22.688438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:22.688355    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:22.947276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:22.947188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:23.102024 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:23.101990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:24.273256 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:24.273220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:24.638852 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:24.638772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:25.571943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:25.571907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:26.683230 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:26.683204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:29:26.738470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:26.738418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:27.728827 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:27.728795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:28.761138 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:28.761098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:29.741161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:29.741131    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:29.899299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:29.899254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:30.039712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:30.039614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:30.751607 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:30.751574    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:31.133299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.133222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:31.422990 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.422917    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"]
Sep 18 13:29:31.423186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.423160    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" podUID="e579bd3b-5176-4b9d-97a1-7585218ec0a9" containerName="maas-api" containerID="cri-o://fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0" gracePeriod=30
Sep 18 13:29:31.476653 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.476620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:31.604023 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.603992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:31.677109 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.677049    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:31.700879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.700844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:31.739999 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.739966    2564 generic.go:356] "Generic (PLEG): container finished" podID="e579bd3b-5176-4b9d-97a1-7585218ec0a9" containerID="fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0" exitCode=0
Sep 18 13:29:31.740160 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.740006    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"
Sep 18 13:29:31.740160 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.740083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" event={"ID":"e579bd3b-5176-4b9d-97a1-7585218ec0a9","Type":"ContainerDied","Data":"fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0"}
Sep 18 13:29:31.740160 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.740155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh" event={"ID":"e579bd3b-5176-4b9d-97a1-7585218ec0a9","Type":"ContainerDied","Data":"1a4606e0984d0096db9e0c68d8e4dcd2df0f9b1fcf4719d9155ddacb111aea24"}
Sep 18 13:29:31.740371 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.740188    2564 scope.go:117] "RemoveContainer" containerID="fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0"
Sep 18 13:29:31.753528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.753436    2564 scope.go:117] "RemoveContainer" containerID="fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0"
Sep 18 13:29:31.753910 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:29:31.753886    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0\": container with ID starting with fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0 not found: ID does not exist" containerID="fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0"
Sep 18 13:29:31.754001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.753922    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0"} err="failed to get container status \"fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0\": rpc error: code = NotFound desc = could not find container \"fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0\": container with ID starting with fbb834d2c004d8d26fcb01394af22c13c9f3ee0fbd094a6547495b1a8b9618e0 not found: ID does not exist"
Sep 18 13:29:31.793272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.793242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npdx9\" (UniqueName: \"kubernetes.io/projected/e579bd3b-5176-4b9d-97a1-7585218ec0a9-kube-api-access-npdx9\") pod \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") "
Sep 18 13:29:31.793397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.793382    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-metrics-certs\") pod \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") "
Sep 18 13:29:31.793475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.793460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e579bd3b-5176-4b9d-97a1-7585218ec0a9-openshift-service-ca\") pod \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") "
Sep 18 13:29:31.793533 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.793519    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls\") pod \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\" (UID: \"e579bd3b-5176-4b9d-97a1-7585218ec0a9\") "
Sep 18 13:29:31.793811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.793784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e579bd3b-5176-4b9d-97a1-7585218ec0a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e579bd3b-5176-4b9d-97a1-7585218ec0a9" (UID: "e579bd3b-5176-4b9d-97a1-7585218ec0a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:29:31.793952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.793930    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e579bd3b-5176-4b9d-97a1-7585218ec0a9-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:29:31.795585 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.795561    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e579bd3b-5176-4b9d-97a1-7585218ec0a9-kube-api-access-npdx9" (OuterVolumeSpecName: "kube-api-access-npdx9") pod "e579bd3b-5176-4b9d-97a1-7585218ec0a9" (UID: "e579bd3b-5176-4b9d-97a1-7585218ec0a9"). InnerVolumeSpecName "kube-api-access-npdx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:29:31.795664 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.795600    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e579bd3b-5176-4b9d-97a1-7585218ec0a9" (UID: "e579bd3b-5176-4b9d-97a1-7585218ec0a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:29:31.795857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.795836    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e579bd3b-5176-4b9d-97a1-7585218ec0a9" (UID: "e579bd3b-5176-4b9d-97a1-7585218ec0a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:29:31.800998 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.800972    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:31.895135 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.895107    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:29:31.895135 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.895132    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npdx9\" (UniqueName: \"kubernetes.io/projected/e579bd3b-5176-4b9d-97a1-7585218ec0a9-kube-api-access-npdx9\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:29:31.895135 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.895141    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e579bd3b-5176-4b9d-97a1-7585218ec0a9-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:29:31.958499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:31.958422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:32.066381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:32.066353    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"]
Sep 18 13:29:32.074883 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:32.074859    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a304aa20-b9b8fbf94-gnhkh"]
Sep 18 13:29:32.117274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:32.117249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:32.553146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:32.553116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:32.661326 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:32.661291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:32.850577 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:32.850548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:33.190042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:33.189958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:33.215232 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:33.215189    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e579bd3b-5176-4b9d-97a1-7585218ec0a9" path="/var/lib/kubelet/pods/e579bd3b-5176-4b9d-97a1-7585218ec0a9/volumes"
Sep 18 13:29:33.366752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:33.366703    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:33.553797 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:33.553759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:34.535523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:34.535488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:35.549748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:35.549714    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:35.963896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:35.963786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:36.061356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:36.061314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:36.474911 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:36.474874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:37.340078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:37.340044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:38.358234 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:38.358185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:39.187856 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.187827    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"]
Sep 18 13:29:39.188294 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.188281    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e579bd3b-5176-4b9d-97a1-7585218ec0a9" containerName="maas-api"
Sep 18 13:29:39.188350 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.188296    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e579bd3b-5176-4b9d-97a1-7585218ec0a9" containerName="maas-api"
Sep 18 13:29:39.188389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.188375    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e579bd3b-5176-4b9d-97a1-7585218ec0a9" containerName="maas-api"
Sep 18 13:29:39.191870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.191851    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.196033 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.196013    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8178145c-serving-cert\""
Sep 18 13:29:39.208229 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.205895    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"]
Sep 18 13:29:39.248527 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.248501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:39.260545 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.260521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3bc7ebd-6f21-4918-9499-ccab6793da24-openshift-service-ca\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.260643 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.260560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kp8d\" (UniqueName: \"kubernetes.io/projected/e3bc7ebd-6f21-4918-9499-ccab6793da24-kube-api-access-9kp8d\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.260720 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.260694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-maas-api-tls\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.260760 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.260730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-metrics-certs\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.346915 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.346888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:39.361238 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.361211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-maas-api-tls\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.361538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.361244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-metrics-certs\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.361538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.361284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3bc7ebd-6f21-4918-9499-ccab6793da24-openshift-service-ca\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.361538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.361310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kp8d\" (UniqueName: \"kubernetes.io/projected/e3bc7ebd-6f21-4918-9499-ccab6793da24-kube-api-access-9kp8d\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.361938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.361920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3bc7ebd-6f21-4918-9499-ccab6793da24-openshift-service-ca\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.363636 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.363615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-maas-api-tls\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.363732 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.363668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-metrics-certs\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.374056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.374038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kp8d\" (UniqueName: \"kubernetes.io/projected/e3bc7ebd-6f21-4918-9499-ccab6793da24-kube-api-access-9kp8d\") pod \"maas-api-e2e-migrate-8178145c-98cfc448d-b278l\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.442592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.442516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:39.502667 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.502640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:39.777346 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.777320    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"]
Sep 18 13:29:39.778458 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:29:39.778432    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3bc7ebd_6f21_4918_9499_ccab6793da24.slice/crio-e432e8ed23109ed67328714e527d78420909ec94ef27a659255a7642b82e949a WatchSource:0}: Error finding container e432e8ed23109ed67328714e527d78420909ec94ef27a659255a7642b82e949a: Status 404 returned error can't find the container with id e432e8ed23109ed67328714e527d78420909ec94ef27a659255a7642b82e949a
Sep 18 13:29:39.793710 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.793684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l" event={"ID":"e3bc7ebd-6f21-4918-9499-ccab6793da24","Type":"ContainerStarted","Data":"e432e8ed23109ed67328714e527d78420909ec94ef27a659255a7642b82e949a"}
Sep 18 13:29:39.915058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:39.915032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:40.064715 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:40.064645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:40.685592 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:40.685552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:40.801178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:40.801147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l" event={"ID":"e3bc7ebd-6f21-4918-9499-ccab6793da24","Type":"ContainerStarted","Data":"0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d"}
Sep 18 13:29:40.801373 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:40.801355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:40.845048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:40.845002    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l" podStartSLOduration=1.523445112 podStartE2EDuration="1.844990106s" totalImagesPullingTime="321.544994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:29:40.842505479 +0000 UTC m=+898.211764862" watchObservedRunningTime="2026-09-18 13:29:40.844990106 +0000 UTC m=+898.214249487"
Sep 18 13:29:41.665320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:41.665286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:42.479920 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:42.479890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:43.133773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.133751    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:29:43.138817 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.138797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:29:43.511310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.511274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:43.561221 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.561175    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"]
Sep 18 13:29:43.566330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.566301    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.569863 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.569832    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-5be8a3\"/\"kube-root-ca.crt\""
Sep 18 13:29:43.569975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.569926    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-5be8a3\"/\"simulator-w5-5be8a3-kserve-self-signed-certs\""
Sep 18 13:29:43.569975 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.569966    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-5be8a3\"/\"openshift-service-ca.crt\""
Sep 18 13:29:43.570101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.570056    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-5be8a3\"/\"default-dockercfg-b7jf8\""
Sep 18 13:29:43.576472 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.576452    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"]
Sep 18 13:29:43.702020 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.701996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ee12f5-2e46-4a94-a24f-97c55084bd84-tls-certs\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.702130 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.702074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-tmp-dir\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.702130 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.702125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-model-cache\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.702225 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.702147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5bpn\" (UniqueName: \"kubernetes.io/projected/36ee12f5-2e46-4a94-a24f-97c55084bd84-kube-api-access-l5bpn\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.702225 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.702170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-home\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.702296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.702227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-dshm\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.794335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.794251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:29:43.803609 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-tmp-dir\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.803694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-model-cache\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.803694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5bpn\" (UniqueName: \"kubernetes.io/projected/36ee12f5-2e46-4a94-a24f-97c55084bd84-kube-api-access-l5bpn\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.803784 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-home\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.803921 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-dshm\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.803981 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-tmp-dir\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.804039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.803976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ee12f5-2e46-4a94-a24f-97c55084bd84-tls-certs\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.804088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.804034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-model-cache\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.804181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.804160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-home\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.805984 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.805961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-dshm\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.806396 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.806380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ee12f5-2e46-4a94-a24f-97c55084bd84-tls-certs\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.815492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.815472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5bpn\" (UniqueName: \"kubernetes.io/projected/36ee12f5-2e46-4a94-a24f-97c55084bd84-kube-api-access-l5bpn\") pod \"simulator-w5-5be8a3-kserve-7fddd58d8-njdpf\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") " pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:43.877715 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:43.877691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:44.159548 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:44.159523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"]
Sep 18 13:29:44.160782 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:29:44.160756    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36ee12f5_2e46_4a94_a24f_97c55084bd84.slice/crio-bfbe19acb9b505fbea9ad8c9d2d54dde2dc0762ccc8171c88a2436feb22e3d65 WatchSource:0}: Error finding container bfbe19acb9b505fbea9ad8c9d2d54dde2dc0762ccc8171c88a2436feb22e3d65: Status 404 returned error can't find the container with id bfbe19acb9b505fbea9ad8c9d2d54dde2dc0762ccc8171c88a2436feb22e3d65
Sep 18 13:29:44.828274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:44.828241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf" event={"ID":"36ee12f5-2e46-4a94-a24f-97c55084bd84","Type":"ContainerStarted","Data":"7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d"}
Sep 18 13:29:44.828622 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:44.828286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf" event={"ID":"36ee12f5-2e46-4a94-a24f-97c55084bd84","Type":"ContainerStarted","Data":"bfbe19acb9b505fbea9ad8c9d2d54dde2dc0762ccc8171c88a2436feb22e3d65"}
Sep 18 13:29:44.853263 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:44.853207    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf" podStartSLOduration=1.853176259 podStartE2EDuration="1.853176259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:29:44.851045644 +0000 UTC m=+902.220305026" watchObservedRunningTime="2026-09-18 13:29:44.853176259 +0000 UTC m=+902.222435667"
Sep 18 13:29:46.812902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:46.812872    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:29:53.878923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:53.878864    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:53.879458 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:53.878941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:53.899737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:53.899709    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:29:54.908396 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:29:54.908369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:30:01.852563 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:01.852524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:03.100672 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:03.100636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:04.248317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:04.248269    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:05.343034 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:05.342999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:06.471965 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:06.471926    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:07.596568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:07.596528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:08.415425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:08.415394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:09.615597 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:09.615568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:10.471141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:10.471111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:11.971986 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:11.971947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:13.327186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:13.327135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:14.460908 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:14.460871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:16.620390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:16.620359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:17.438310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.438277    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"]
Sep 18 13:30:17.438552 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.438526    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l" podUID="e3bc7ebd-6f21-4918-9499-ccab6793da24" containerName="maas-api" containerID="cri-o://0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d" gracePeriod=30
Sep 18 13:30:17.529781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.529748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:17.649811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.649735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:17.710646 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.710626    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:30:17.754233 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.754185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:17.810492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.810469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kp8d\" (UniqueName: \"kubernetes.io/projected/e3bc7ebd-6f21-4918-9499-ccab6793da24-kube-api-access-9kp8d\") pod \"e3bc7ebd-6f21-4918-9499-ccab6793da24\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") "
Sep 18 13:30:17.810663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.810647    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-maas-api-tls\") pod \"e3bc7ebd-6f21-4918-9499-ccab6793da24\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") "
Sep 18 13:30:17.810736 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.810714    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-metrics-certs\") pod \"e3bc7ebd-6f21-4918-9499-ccab6793da24\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") "
Sep 18 13:30:17.810799 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.810778    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3bc7ebd-6f21-4918-9499-ccab6793da24-openshift-service-ca\") pod \"e3bc7ebd-6f21-4918-9499-ccab6793da24\" (UID: \"e3bc7ebd-6f21-4918-9499-ccab6793da24\") "
Sep 18 13:30:17.811171 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.811144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3bc7ebd-6f21-4918-9499-ccab6793da24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3bc7ebd-6f21-4918-9499-ccab6793da24" (UID: "e3bc7ebd-6f21-4918-9499-ccab6793da24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:30:17.812557 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.812537    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3bc7ebd-6f21-4918-9499-ccab6793da24-kube-api-access-9kp8d" (OuterVolumeSpecName: "kube-api-access-9kp8d") pod "e3bc7ebd-6f21-4918-9499-ccab6793da24" (UID: "e3bc7ebd-6f21-4918-9499-ccab6793da24"). InnerVolumeSpecName "kube-api-access-9kp8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:30:17.812689 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.812674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3bc7ebd-6f21-4918-9499-ccab6793da24" (UID: "e3bc7ebd-6f21-4918-9499-ccab6793da24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:30:17.812789 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.812769    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e3bc7ebd-6f21-4918-9499-ccab6793da24" (UID: "e3bc7ebd-6f21-4918-9499-ccab6793da24"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:30:17.870006 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.869979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:17.912422 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.912398    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3bc7ebd-6f21-4918-9499-ccab6793da24-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:30:17.912422 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.912422    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kp8d\" (UniqueName: \"kubernetes.io/projected/e3bc7ebd-6f21-4918-9499-ccab6793da24-kube-api-access-9kp8d\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:30:17.912575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.912433    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:30:17.912575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:17.912442    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bc7ebd-6f21-4918-9499-ccab6793da24-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:30:18.007081 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.007048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:18.047163 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.047114    2564 generic.go:356] "Generic (PLEG): container finished" podID="e3bc7ebd-6f21-4918-9499-ccab6793da24" containerID="0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d" exitCode=0
Sep 18 13:30:18.047395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.047260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l" event={"ID":"e3bc7ebd-6f21-4918-9499-ccab6793da24","Type":"ContainerDied","Data":"0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d"}
Sep 18 13:30:18.047395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.047342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l" event={"ID":"e3bc7ebd-6f21-4918-9499-ccab6793da24","Type":"ContainerDied","Data":"e432e8ed23109ed67328714e527d78420909ec94ef27a659255a7642b82e949a"}
Sep 18 13:30:18.047395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.047382    2564 scope.go:117] "RemoveContainer" containerID="0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d"
Sep 18 13:30:18.047812 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.047584    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"
Sep 18 13:30:18.059467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.059334    2564 scope.go:117] "RemoveContainer" containerID="0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d"
Sep 18 13:30:18.059660 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:30:18.059628    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d\": container with ID starting with 0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d not found: ID does not exist" containerID="0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d"
Sep 18 13:30:18.059765 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.059669    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d"} err="failed to get container status \"0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d\": rpc error: code = NotFound desc = could not find container \"0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d\": container with ID starting with 0b936a8bbd02f8493b679ba7fa2235a66c119fa8114926f7632e7f6b69d35f9d not found: ID does not exist"
Sep 18 13:30:18.079415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.079388    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"]
Sep 18 13:30:18.083573 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.083552    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8178145c-98cfc448d-b278l"]
Sep 18 13:30:18.116967 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.116940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:18.577358 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.577316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:18.700500 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:18.700462    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:19.051153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:19.051114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:19.214974 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:19.214944    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3bc7ebd-6f21-4918-9499-ccab6793da24" path="/var/lib/kubelet/pods/e3bc7ebd-6f21-4918-9499-ccab6793da24/volumes"
Sep 18 13:30:19.224014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:19.223985    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:19.562088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:19.562060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:19.887902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:19.887805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:20.511656 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:20.511624    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:21.532940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.532901    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:21.965571 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.965492    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"]
Sep 18 13:30:21.965958 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.965945    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bc7ebd-6f21-4918-9499-ccab6793da24" containerName="maas-api"
Sep 18 13:30:21.966006 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.965959    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bc7ebd-6f21-4918-9499-ccab6793da24" containerName="maas-api"
Sep 18 13:30:21.966041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.966037    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3bc7ebd-6f21-4918-9499-ccab6793da24" containerName="maas-api"
Sep 18 13:30:21.970585 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.970561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:21.974531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.974508    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-951469\"/\"kube-root-ca.crt\""
Sep 18 13:30:21.975063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.975041    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-951469\"/\"simulator-w0-951469-kserve-self-signed-certs\""
Sep 18 13:30:21.975206 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.975172    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-951469\"/\"default-dockercfg-lxfdl\""
Sep 18 13:30:21.975312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.975278    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-951469\"/\"openshift-service-ca.crt\""
Sep 18 13:30:21.982878 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:21.982854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"]
Sep 18 13:30:22.029641 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.029613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:22.051964 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.051939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7w9q\" (UniqueName: \"kubernetes.io/projected/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-kube-api-access-m7w9q\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.052102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.051995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-dshm\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.052102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.052050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tmp-dir\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.052102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.052091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-home\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.052282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.052122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tls-certs\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.052282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.052269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-model-cache\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.152962 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.152929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7w9q\" (UniqueName: \"kubernetes.io/projected/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-kube-api-access-m7w9q\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.152998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-dshm\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tmp-dir\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-home\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tls-certs\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153378 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-model-cache\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153540 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-home\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153540 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tmp-dir\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.153665 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.153585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-model-cache\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.155620 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.155587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-dshm\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.155717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.155679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tls-certs\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.165455 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.165436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7w9q\" (UniqueName: \"kubernetes.io/projected/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-kube-api-access-m7w9q\") pod \"simulator-w0-951469-kserve-5bbf9dd96c-rmxqz\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") " pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.218573 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.218509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:22.280811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.280778    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:22.562421 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.562393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"]
Sep 18 13:30:22.563078 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:30:22.563047    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7438b1d1_6cbe_4aeb_9c58_e4f00858bf6d.slice/crio-8135bc072d73a0ddaf6602a5565d1017e7716f3c814df99026ddbcdf97055a6f WatchSource:0}: Error finding container 8135bc072d73a0ddaf6602a5565d1017e7716f3c814df99026ddbcdf97055a6f: Status 404 returned error can't find the container with id 8135bc072d73a0ddaf6602a5565d1017e7716f3c814df99026ddbcdf97055a6f
Sep 18 13:30:22.833646 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:22.833565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:23.081710 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:23.081680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz" event={"ID":"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d","Type":"ContainerStarted","Data":"fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6"}
Sep 18 13:30:23.081860 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:23.081729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz" event={"ID":"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d","Type":"ContainerStarted","Data":"8135bc072d73a0ddaf6602a5565d1017e7716f3c814df99026ddbcdf97055a6f"}
Sep 18 13:30:23.107481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:23.107389    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz" podStartSLOduration=2.10736887 podStartE2EDuration="2.10736887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:30:23.106889144 +0000 UTC m=+940.476148523" watchObservedRunningTime="2026-09-18 13:30:23.10736887 +0000 UTC m=+940.476628253"
Sep 18 13:30:24.112821 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:24.112783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:25.206436 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.206401    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"]
Sep 18 13:30:25.210359 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.210331    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.213635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.213613    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-92246a6e-serving-cert\""
Sep 18 13:30:25.237768 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.237743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"]
Sep 18 13:30:25.272048 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.272012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:25.282083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.282060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-metrics-certs\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.282186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.282107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xfv6\" (UniqueName: \"kubernetes.io/projected/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-kube-api-access-5xfv6\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.282186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.282165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-openshift-service-ca\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.282296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.282236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.374779 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.374743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:25.383787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.383765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-metrics-certs\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.383878 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.383817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfv6\" (UniqueName: \"kubernetes.io/projected/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-kube-api-access-5xfv6\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.383878 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.383861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-openshift-service-ca\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.383958 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.383897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.384011 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:30:25.383996    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-serving-cert: secret "maas-api-e2e-ait-92246a6e-serving-cert" not found
Sep 18 13:30:25.384067 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:30:25.384057    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls podName:edc3fa53-d23c-41ac-a4d1-0ab9570647f4 nodeName:}" failed. No retries permitted until 2026-09-18 13:30:25.884038577 +0000 UTC m=+943.253297953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls") pod "maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" (UID: "edc3fa53-d23c-41ac-a4d1-0ab9570647f4") : secret "maas-api-e2e-ait-92246a6e-serving-cert" not found
Sep 18 13:30:25.384615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.384592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-openshift-service-ca\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.386235 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.386216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-metrics-certs\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.397608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.397582    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xfv6\" (UniqueName: \"kubernetes.io/projected/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-kube-api-access-5xfv6\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.796850 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.796818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:25.889356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.889329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:25.891809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:25.891787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls\") pod \"maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:26.053528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:26.053442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:26.122506 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:26.122480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:26.346968 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:26.346890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:26.442283 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:26.442252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"]
Sep 18 13:30:26.445284 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:30:26.445258    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc3fa53_d23c_41ac_a4d1_0ab9570647f4.slice/crio-fe681a10da10494022c14606fae1565cb6767dade4d073c4d23d6a0e9ceceaca WatchSource:0}: Error finding container fe681a10da10494022c14606fae1565cb6767dade4d073c4d23d6a0e9ceceaca: Status 404 returned error can't find the container with id fe681a10da10494022c14606fae1565cb6767dade4d073c4d23d6a0e9ceceaca
Sep 18 13:30:26.446817 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:26.446798    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:30:27.008585 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:27.008548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:27.112997 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:27.112958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" event={"ID":"edc3fa53-d23c-41ac-a4d1-0ab9570647f4","Type":"ContainerStarted","Data":"7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e"}
Sep 18 13:30:27.113164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:27.113008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" event={"ID":"edc3fa53-d23c-41ac-a4d1-0ab9570647f4","Type":"ContainerStarted","Data":"fe681a10da10494022c14606fae1565cb6767dade4d073c4d23d6a0e9ceceaca"}
Sep 18 13:30:27.113164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:27.113065    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:27.168868 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:27.168792    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" podStartSLOduration=1.7421203859999999 podStartE2EDuration="2.168778854s" totalImagesPullingTime="426.658468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:30:27.168371733 +0000 UTC m=+944.537631112" watchObservedRunningTime="2026-09-18 13:30:27.168778854 +0000 UTC m=+944.538038235"
Sep 18 13:30:28.554115 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:28.554081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:29.909292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:29.909256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:31.242903 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:31.242872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:32.281875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:32.281844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:32.282366 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:32.281887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:32.294308 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:32.294281    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:33.124231 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:33.124205    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:30:33.160596 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:33.160568    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:30:36.143689 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:36.143644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:46.888358 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:46.888308    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:48.540781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:48.540728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:48.646332 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:48.646293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:49.259117 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:49.259080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:50.051865 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:50.051833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:50.968572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:50.968537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:51.275829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:51.275794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:52.267911 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:52.267839    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:53.464046 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:53.464009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:54.445298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:54.445268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:55.201459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:55.201420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:55.999252 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:55.999216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:56.960282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:56.960241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:57.749331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:57.749279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:58.829655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:58.829623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:30:59.597411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:30:59.597378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:01.512989 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:01.512948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:03.619544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:03.619508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:04.446462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.446429    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"]
Sep 18 13:31:04.446635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.446612    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" podUID="edc3fa53-d23c-41ac-a4d1-0ab9570647f4" containerName="maas-api" containerID="cri-o://7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e" gracePeriod=30
Sep 18 13:31:04.502087 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.502058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:04.717017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.716992    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:31:04.743692 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.743659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:04.843682 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.843652    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xfv6\" (UniqueName: \"kubernetes.io/projected/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-kube-api-access-5xfv6\") pod \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") "
Sep 18 13:31:04.843831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.843737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls\") pod \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") "
Sep 18 13:31:04.843831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.843785    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-openshift-service-ca\") pod \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") "
Sep 18 13:31:04.843942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.843851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-metrics-certs\") pod \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\" (UID: \"edc3fa53-d23c-41ac-a4d1-0ab9570647f4\") "
Sep 18 13:31:04.844286 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.844246    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edc3fa53-d23c-41ac-a4d1-0ab9570647f4" (UID: "edc3fa53-d23c-41ac-a4d1-0ab9570647f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:31:04.846022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.845995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-kube-api-access-5xfv6" (OuterVolumeSpecName: "kube-api-access-5xfv6") pod "edc3fa53-d23c-41ac-a4d1-0ab9570647f4" (UID: "edc3fa53-d23c-41ac-a4d1-0ab9570647f4"). InnerVolumeSpecName "kube-api-access-5xfv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:31:04.846154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.846048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edc3fa53-d23c-41ac-a4d1-0ab9570647f4" (UID: "edc3fa53-d23c-41ac-a4d1-0ab9570647f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:31:04.846333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.846312    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "edc3fa53-d23c-41ac-a4d1-0ab9570647f4" (UID: "edc3fa53-d23c-41ac-a4d1-0ab9570647f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:31:04.919088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.919062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:04.945783 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.945759    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:04.945783 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.945780    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xfv6\" (UniqueName: \"kubernetes.io/projected/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-kube-api-access-5xfv6\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:04.946001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.945790    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:04.946001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:04.945801    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc3fa53-d23c-41ac-a4d1-0ab9570647f4-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:05.005053 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.005017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:05.090009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.089984    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:05.362123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.362042    2564 generic.go:356] "Generic (PLEG): container finished" podID="edc3fa53-d23c-41ac-a4d1-0ab9570647f4" containerID="7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e" exitCode=0
Sep 18 13:31:05.362123 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.362089    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"
Sep 18 13:31:05.362342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.362139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" event={"ID":"edc3fa53-d23c-41ac-a4d1-0ab9570647f4","Type":"ContainerDied","Data":"7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e"}
Sep 18 13:31:05.362342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.362187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc" event={"ID":"edc3fa53-d23c-41ac-a4d1-0ab9570647f4","Type":"ContainerDied","Data":"fe681a10da10494022c14606fae1565cb6767dade4d073c4d23d6a0e9ceceaca"}
Sep 18 13:31:05.362342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.362238    2564 scope.go:117] "RemoveContainer" containerID="7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e"
Sep 18 13:31:05.375030 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.374980    2564 scope.go:117] "RemoveContainer" containerID="7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e"
Sep 18 13:31:05.375467 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:31:05.375444    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e\": container with ID starting with 7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e not found: ID does not exist" containerID="7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e"
Sep 18 13:31:05.375561 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.375478    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e"} err="failed to get container status \"7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e\": rpc error: code = NotFound desc = could not find container \"7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e\": container with ID starting with 7cbeb500bab4d07fbe5d72df622a9bb94bd59fe30dca59ce8e968bdcadd78b8e not found: ID does not exist"
Sep 18 13:31:05.384064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.384039    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"]
Sep 18 13:31:05.387918 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.387897    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92246a6e-58877d49f7-2n8kc"]
Sep 18 13:31:05.437460 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:05.437427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:06.199014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:06.198979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:06.299698 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:06.299660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:06.733303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:06.733268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:07.063041 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:07.063003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:07.216893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:07.216858    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc3fa53-d23c-41ac-a4d1-0ab9570647f4" path="/var/lib/kubelet/pods/edc3fa53-d23c-41ac-a4d1-0ab9570647f4/volumes"
Sep 18 13:31:07.225439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:07.225407    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:07.459998 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:07.459908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:07.997737 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:07.997704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:08.824559 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:08.824528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:08.928475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:08.928437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:09.319483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:09.319443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:09.460462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:09.460425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:09.764347 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:09.764318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:10.661251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.661213    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"]
Sep 18 13:31:10.661712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.661659    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc3fa53-d23c-41ac-a4d1-0ab9570647f4" containerName="maas-api"
Sep 18 13:31:10.661712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.661671    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc3fa53-d23c-41ac-a4d1-0ab9570647f4" containerName="maas-api"
Sep 18 13:31:10.661842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.661758    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc3fa53-d23c-41ac-a4d1-0ab9570647f4" containerName="maas-api"
Sep 18 13:31:10.665262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.665240    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.667907 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.667890    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-cc741da4-serving-cert\""
Sep 18 13:31:10.679601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.679579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"]
Sep 18 13:31:10.701930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.701889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:10.802723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.802700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-maas-api-tls\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.802846 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.802771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-metrics-certs\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.802889 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.802868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6n5b\" (UniqueName: \"kubernetes.io/projected/5f32c9df-4643-499a-b423-378ae0b179ad-kube-api-access-t6n5b\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.802929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.802910    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f32c9df-4643-499a-b423-378ae0b179ad-openshift-service-ca\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.805125 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.805100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:10.903452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.903418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f32c9df-4643-499a-b423-378ae0b179ad-openshift-service-ca\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.903615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.903519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-maas-api-tls\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.903615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.903579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-metrics-certs\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.903730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.903666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6n5b\" (UniqueName: \"kubernetes.io/projected/5f32c9df-4643-499a-b423-378ae0b179ad-kube-api-access-t6n5b\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.903818 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.903793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:10.904205 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.904160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f32c9df-4643-499a-b423-378ae0b179ad-openshift-service-ca\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.906002 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.905977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-maas-api-tls\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.906002 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.905995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-metrics-certs\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.912511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.912459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6n5b\" (UniqueName: \"kubernetes.io/projected/5f32c9df-4643-499a-b423-378ae0b179ad-kube-api-access-t6n5b\") pod \"maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:10.976671 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:10.976649    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:11.237995 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:11.237962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:11.259933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:11.259903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"]
Sep 18 13:31:11.262544 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:31:11.262495    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f32c9df_4643_499a_b423_378ae0b179ad.slice/crio-72b6f8579ad73a593d176f2778b8fe45414bc2f44b42d83a6cf6015389cd7e3a WatchSource:0}: Error finding container 72b6f8579ad73a593d176f2778b8fe45414bc2f44b42d83a6cf6015389cd7e3a: Status 404 returned error can't find the container with id 72b6f8579ad73a593d176f2778b8fe45414bc2f44b42d83a6cf6015389cd7e3a
Sep 18 13:31:11.334775 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:11.334736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:11.416473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:11.416437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d" event={"ID":"5f32c9df-4643-499a-b423-378ae0b179ad","Type":"ContainerStarted","Data":"72b6f8579ad73a593d176f2778b8fe45414bc2f44b42d83a6cf6015389cd7e3a"}
Sep 18 13:31:11.886580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:11.886553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:12.423832 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:12.423792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d" event={"ID":"5f32c9df-4643-499a-b423-378ae0b179ad","Type":"ContainerStarted","Data":"e250dbf2ecc5450602fead9c84233ab0500aad84473ef89262116aea5ee11499"}
Sep 18 13:31:12.424033 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:12.423883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:12.452788 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:12.452726    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d" podStartSLOduration=1.921494036 podStartE2EDuration="2.452711244s" totalImagesPullingTime="531.217208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:31:12.449012817 +0000 UTC m=+989.818272200" watchObservedRunningTime="2026-09-18 13:31:12.452711244 +0000 UTC m=+989.821970683"
Sep 18 13:31:12.923709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:12.923678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:13.808456 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:13.808422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:14.609679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:14.609641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:15.403324 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:15.403287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:18.434666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:18.434630    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:23.769212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:23.769156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:24.796657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:24.796619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:25.780349 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:25.780306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:26.724181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:26.724149    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:27.646506 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:27.646466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:28.553952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:28.553917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:28.892686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:28.892601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:29.634499 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:29.634456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:30.517928 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:30.517893    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:31.531601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:31.531559    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:32.457134 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:32.457100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:33.674562 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:33.674517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:34.954535 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:34.954498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:35.760182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:35.760147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:36.656169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:36.656133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:37.598876 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:37.598836    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:38.339553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.339521    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"]
Sep 18 13:31:38.339945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.339715    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn" podUID="fbca19b6-0534-42fa-afe5-6f03159493e2" containerName="maas-api" containerID="cri-o://c5489ca787f8cd1f10f2d23eb67e48e55a5a35c1bd620f97fd56193b44387b64" gracePeriod=30
Sep 18 13:31:38.405404 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.405377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:38.528183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.528150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:38.592065 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.592041    2564 generic.go:356] "Generic (PLEG): container finished" podID="fbca19b6-0534-42fa-afe5-6f03159493e2" containerID="c5489ca787f8cd1f10f2d23eb67e48e55a5a35c1bd620f97fd56193b44387b64" exitCode=0
Sep 18 13:31:38.592232 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.592115    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn" event={"ID":"fbca19b6-0534-42fa-afe5-6f03159493e2","Type":"ContainerDied","Data":"c5489ca787f8cd1f10f2d23eb67e48e55a5a35c1bd620f97fd56193b44387b64"}
Sep 18 13:31:38.592232 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.592166    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn" event={"ID":"fbca19b6-0534-42fa-afe5-6f03159493e2","Type":"ContainerDied","Data":"3e1aef2f838befe5d4d6824bc3b1c0d35f106f6052d286252a8dfd3f023c8ce7"}
Sep 18 13:31:38.592232 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.592186    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e1aef2f838befe5d4d6824bc3b1c0d35f106f6052d286252a8dfd3f023c8ce7"
Sep 18 13:31:38.600299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.600277    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:31:38.682490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.682464    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-maas-api-tls\") pod \"fbca19b6-0534-42fa-afe5-6f03159493e2\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") "
Sep 18 13:31:38.682658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.682512    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-metrics-certs\") pod \"fbca19b6-0534-42fa-afe5-6f03159493e2\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") "
Sep 18 13:31:38.682658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.682555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbca19b6-0534-42fa-afe5-6f03159493e2-openshift-service-ca\") pod \"fbca19b6-0534-42fa-afe5-6f03159493e2\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") "
Sep 18 13:31:38.682658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.682613    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5xwh\" (UniqueName: \"kubernetes.io/projected/fbca19b6-0534-42fa-afe5-6f03159493e2-kube-api-access-x5xwh\") pod \"fbca19b6-0534-42fa-afe5-6f03159493e2\" (UID: \"fbca19b6-0534-42fa-afe5-6f03159493e2\") "
Sep 18 13:31:38.682954 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.682929    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbca19b6-0534-42fa-afe5-6f03159493e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbca19b6-0534-42fa-afe5-6f03159493e2" (UID: "fbca19b6-0534-42fa-afe5-6f03159493e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:31:38.684630 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.684604    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbca19b6-0534-42fa-afe5-6f03159493e2" (UID: "fbca19b6-0534-42fa-afe5-6f03159493e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:31:38.684725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.684624    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fbca19b6-0534-42fa-afe5-6f03159493e2" (UID: "fbca19b6-0534-42fa-afe5-6f03159493e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:31:38.684725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.684604    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbca19b6-0534-42fa-afe5-6f03159493e2-kube-api-access-x5xwh" (OuterVolumeSpecName: "kube-api-access-x5xwh") pod "fbca19b6-0534-42fa-afe5-6f03159493e2" (UID: "fbca19b6-0534-42fa-afe5-6f03159493e2"). InnerVolumeSpecName "kube-api-access-x5xwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:31:38.726443 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.726409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:38.783601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.783577    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:38.783601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.783601    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbca19b6-0534-42fa-afe5-6f03159493e2-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:38.783757 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.783615    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbca19b6-0534-42fa-afe5-6f03159493e2-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:38.783757 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.783627    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5xwh\" (UniqueName: \"kubernetes.io/projected/fbca19b6-0534-42fa-afe5-6f03159493e2-kube-api-access-x5xwh\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:38.859260 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:38.859174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:39.267150 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:39.267123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:39.599897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:39.599866    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"
Sep 18 13:31:39.631314 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:39.631277    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"]
Sep 18 13:31:39.640558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:39.640526    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-b7292e-699bf5954b-rjdhn"]
Sep 18 13:31:39.797632 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:39.797593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:41.051300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:41.051261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:41.216392 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:41.216362    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbca19b6-0534-42fa-afe5-6f03159493e2" path="/var/lib/kubelet/pods/fbca19b6-0534-42fa-afe5-6f03159493e2/volumes"
Sep 18 13:31:42.219590 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:42.219550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:43.429108 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:43.429069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:44.395639 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.395608    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"]
Sep 18 13:31:44.395824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.395796    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d" podUID="5f32c9df-4643-499a-b423-378ae0b179ad" containerName="maas-api" containerID="cri-o://e250dbf2ecc5450602fead9c84233ab0500aad84473ef89262116aea5ee11499" gracePeriod=30
Sep 18 13:31:44.416138 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.416114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:44.546525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.546491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:44.633504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.633474    2564 generic.go:356] "Generic (PLEG): container finished" podID="5f32c9df-4643-499a-b423-378ae0b179ad" containerID="e250dbf2ecc5450602fead9c84233ab0500aad84473ef89262116aea5ee11499" exitCode=0
Sep 18 13:31:44.633669 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.633542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d" event={"ID":"5f32c9df-4643-499a-b423-378ae0b179ad","Type":"ContainerDied","Data":"e250dbf2ecc5450602fead9c84233ab0500aad84473ef89262116aea5ee11499"}
Sep 18 13:31:44.652467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.652388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:44.661001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.660979    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:44.742024 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.741969    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-maas-api-tls\") pod \"5f32c9df-4643-499a-b423-378ae0b179ad\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") "
Sep 18 13:31:44.742189 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.742091    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-metrics-certs\") pod \"5f32c9df-4643-499a-b423-378ae0b179ad\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") "
Sep 18 13:31:44.742359 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.742339    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6n5b\" (UniqueName: \"kubernetes.io/projected/5f32c9df-4643-499a-b423-378ae0b179ad-kube-api-access-t6n5b\") pod \"5f32c9df-4643-499a-b423-378ae0b179ad\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") "
Sep 18 13:31:44.742403 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.742375    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f32c9df-4643-499a-b423-378ae0b179ad-openshift-service-ca\") pod \"5f32c9df-4643-499a-b423-378ae0b179ad\" (UID: \"5f32c9df-4643-499a-b423-378ae0b179ad\") "
Sep 18 13:31:44.742801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.742774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f32c9df-4643-499a-b423-378ae0b179ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f32c9df-4643-499a-b423-378ae0b179ad" (UID: "5f32c9df-4643-499a-b423-378ae0b179ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:31:44.744351 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.744320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f32c9df-4643-499a-b423-378ae0b179ad-kube-api-access-t6n5b" (OuterVolumeSpecName: "kube-api-access-t6n5b") pod "5f32c9df-4643-499a-b423-378ae0b179ad" (UID: "5f32c9df-4643-499a-b423-378ae0b179ad"). InnerVolumeSpecName "kube-api-access-t6n5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:31:44.744680 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.744652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5f32c9df-4643-499a-b423-378ae0b179ad" (UID: "5f32c9df-4643-499a-b423-378ae0b179ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:31:44.744780 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.744681    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f32c9df-4643-499a-b423-378ae0b179ad" (UID: "5f32c9df-4643-499a-b423-378ae0b179ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:31:44.754930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.754898    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:44.843762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.843726    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:44.843762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.843754    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f32c9df-4643-499a-b423-378ae0b179ad-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:44.843762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.843765    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6n5b\" (UniqueName: \"kubernetes.io/projected/5f32c9df-4643-499a-b423-378ae0b179ad-kube-api-access-t6n5b\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:44.843998 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.843776    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f32c9df-4643-499a-b423-378ae0b179ad-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:31:44.868824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.868786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:44.974494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:44.974413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:45.085015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.084979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:45.644714 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.644683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d" event={"ID":"5f32c9df-4643-499a-b423-378ae0b179ad","Type":"ContainerDied","Data":"72b6f8579ad73a593d176f2778b8fe45414bc2f44b42d83a6cf6015389cd7e3a"}
Sep 18 13:31:45.645147 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.644726    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"
Sep 18 13:31:45.645147 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.644760    2564 scope.go:117] "RemoveContainer" containerID="e250dbf2ecc5450602fead9c84233ab0500aad84473ef89262116aea5ee11499"
Sep 18 13:31:45.683748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.683725    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"]
Sep 18 13:31:45.686380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.686359    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cc741da4-5d8c8c5c9d-qbc8d"]
Sep 18 13:31:45.794572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.794539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:45.909049 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:45.908974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:46.107952 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:46.107919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:47.215274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:47.215241    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f32c9df-4643-499a-b423-378ae0b179ad" path="/var/lib/kubelet/pods/5f32c9df-4643-499a-b423-378ae0b179ad/volumes"
Sep 18 13:31:47.568988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:47.568949    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:47.847363 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:47.847283    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:48.739399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:48.739365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:48.890132 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:48.890097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:49.014155 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:49.014063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:49.156293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:49.156263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:49.581184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:49.581149    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:50.035026 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:50.034987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:50.287174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:50.287083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:50.548457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:50.548365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:51.458546 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:51.458514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:56.054473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:56.054437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:56.765268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:56.765224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:56.914475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:56.914439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:57.334254 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:57.334224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:57.607012 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:57.606924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:57.814441 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:57.814393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:58.294039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:58.294000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:31:59.296343 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:31:59.296310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:00.492406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:00.492373    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:01.605507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:01.605470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:02.607625 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.607595    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"]
Sep 18 13:32:02.608042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.608029    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbca19b6-0534-42fa-afe5-6f03159493e2" containerName="maas-api"
Sep 18 13:32:02.608094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.608043    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbca19b6-0534-42fa-afe5-6f03159493e2" containerName="maas-api"
Sep 18 13:32:02.608094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.608064    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f32c9df-4643-499a-b423-378ae0b179ad" containerName="maas-api"
Sep 18 13:32:02.608094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.608069    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f32c9df-4643-499a-b423-378ae0b179ad" containerName="maas-api"
Sep 18 13:32:02.608208 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.608138    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f32c9df-4643-499a-b423-378ae0b179ad" containerName="maas-api"
Sep 18 13:32:02.608208 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.608147    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbca19b6-0534-42fa-afe5-6f03159493e2" containerName="maas-api"
Sep 18 13:32:02.612833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.612813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.615542 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.615522    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-808e44-serving-cert\""
Sep 18 13:32:02.631248 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.631224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"]
Sep 18 13:32:02.657886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.657850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:02.728375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.728351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-metrics-certs\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.728507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.728385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk45v\" (UniqueName: \"kubernetes.io/projected/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-kube-api-access-jk45v\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.728507 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.728407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-openshift-service-ca\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.728639 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.728520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-maas-api-tls\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.752773 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.752749    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:02.829910 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.829886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-maas-api-tls\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.830021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.829971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-metrics-certs\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.830021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.829996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk45v\" (UniqueName: \"kubernetes.io/projected/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-kube-api-access-jk45v\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.830021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.830015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-openshift-service-ca\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.830620 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.830598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-openshift-service-ca\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.832401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.832383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-maas-api-tls\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.832485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.832388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-metrics-certs\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.839106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.839078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk45v\" (UniqueName: \"kubernetes.io/projected/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-kube-api-access-jk45v\") pod \"maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:02.862607 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.862526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:02.923765 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:02.923747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:03.232310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.232121    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"]
Sep 18 13:32:03.234781 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:32:03.234755    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7a3c8f_dd79_4f41_a0fd_a2d545d20555.slice/crio-792e1356b5eecbd1c082fa14806cc6ff282b11d922179a884621186a4c83836e WatchSource:0}: Error finding container 792e1356b5eecbd1c082fa14806cc6ff282b11d922179a884621186a4c83836e: Status 404 returned error can't find the container with id 792e1356b5eecbd1c082fa14806cc6ff282b11d922179a884621186a4c83836e
Sep 18 13:32:03.413808 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.413780    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:03.570094 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.570054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:03.758596 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.758554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt" event={"ID":"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555","Type":"ContainerStarted","Data":"19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6"}
Sep 18 13:32:03.758993 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.758613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt" event={"ID":"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555","Type":"ContainerStarted","Data":"792e1356b5eecbd1c082fa14806cc6ff282b11d922179a884621186a4c83836e"}
Sep 18 13:32:03.758993 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.758653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:03.785090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:03.785047    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt" podStartSLOduration=1.342489443 podStartE2EDuration="1.785030881s" totalImagesPullingTime="442.541438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:32:03.781676157 +0000 UTC m=+1041.150935539" watchObservedRunningTime="2026-09-18 13:32:03.785030881 +0000 UTC m=+1041.154290263"
Sep 18 13:32:09.249162 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:09.249118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:09.770173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:09.770147    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:32:12.144796 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:12.144766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:24.411063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:24.411027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:25.563064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:25.563022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:26.904311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:26.904265    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:27.009875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:27.009844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:28.216381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:28.216318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:29.484685 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:29.484641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:30.562437 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:30.562392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:31.463572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:31.463536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:32.180577 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:32.180540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:32.411597 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:32.411562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:32.591049 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:32.591009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:38.125406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:38.125311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:38.364107 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:38.364070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:46.709161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:46.709120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:48.389372 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:48.389338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:56.067230 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:56.067178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:56.193811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:56.193784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:32:56.323178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:32:56.323102    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:06.907060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:06.907019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:07.855938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:07.855902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:14.574504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:14.574465    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:14.685670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:14.685622    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:14.780349 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:14.780315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:14.882873 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:14.882763    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:15.671390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:15.671356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:15.831869 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:15.831830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:17.585612 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:17.585570    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:18.313228 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:18.313179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:20.315786 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:20.315735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:20.416685 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:20.416652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:23.515477 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:23.515433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:23.615010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:23.614959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:24.260158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:24.260117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:31.089027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:31.088964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:31.194224 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:31.194167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:31.323594 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:31.323558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:31.714289 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:31.714254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:32.626701 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:32.626665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:38.812554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:38.812517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:39.563500 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:39.563464    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:39.660740 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:39.660705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:40.637627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:40.637588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:41.591175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:41.591138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:42.807382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:42.807347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:43.751532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:43.751500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:44.660673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.660638    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"]
Sep 18 13:33:44.664406 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.664386    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.666923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.666906    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bb3ce27c-serving-cert\""
Sep 18 13:33:44.676466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.676444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"]
Sep 18 13:33:44.693408 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.693380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:44.718045 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.718012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.718045 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.718050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-metrics-certs\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.718242 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.718066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr9cw\" (UniqueName: \"kubernetes.io/projected/3426464d-a5d9-4a99-a0b4-4d25d503968a-kube-api-access-gr9cw\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.718242 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.718217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3426464d-a5d9-4a99-a0b4-4d25d503968a-openshift-service-ca\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.767755 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.767671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:44.819309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.819277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3426464d-a5d9-4a99-a0b4-4d25d503968a-openshift-service-ca\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.819496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.819344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.819496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.819363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-metrics-certs\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.819496 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.819378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr9cw\" (UniqueName: \"kubernetes.io/projected/3426464d-a5d9-4a99-a0b4-4d25d503968a-kube-api-access-gr9cw\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.819683 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:33:44.819512    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-serving-cert: secret "maas-api-e2e-mt-bb3ce27c-serving-cert" not found
Sep 18 13:33:44.819683 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:33:44.819588    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls podName:3426464d-a5d9-4a99-a0b4-4d25d503968a nodeName:}" failed. No retries permitted until 2026-09-18 13:33:45.319565913 +0000 UTC m=+1142.688825289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls") pod "maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" (UID: "3426464d-a5d9-4a99-a0b4-4d25d503968a") : secret "maas-api-e2e-mt-bb3ce27c-serving-cert" not found
Sep 18 13:33:44.820022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.820000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3426464d-a5d9-4a99-a0b4-4d25d503968a-openshift-service-ca\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.821891 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.821874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-metrics-certs\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:44.832803 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:44.832777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr9cw\" (UniqueName: \"kubernetes.io/projected/3426464d-a5d9-4a99-a0b4-4d25d503968a-kube-api-access-gr9cw\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:45.107091 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.107044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:45.265756 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.265725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:45.325589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.325556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:45.328014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.327990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls\") pod \"maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:45.360552 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.360450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:45.575601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.575561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:45.863503 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:45.863471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"]
Sep 18 13:33:45.864003 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:33:45.863980    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3426464d_a5d9_4a99_a0b4_4d25d503968a.slice/crio-a6f0bc6d821d42c3da476a0b577fbac59a511c561c79396d263146c3631879cd WatchSource:0}: Error finding container a6f0bc6d821d42c3da476a0b577fbac59a511c561c79396d263146c3631879cd: Status 404 returned error can't find the container with id a6f0bc6d821d42c3da476a0b577fbac59a511c561c79396d263146c3631879cd
Sep 18 13:33:46.403492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:46.403455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" event={"ID":"3426464d-a5d9-4a99-a0b4-4d25d503968a","Type":"ContainerStarted","Data":"325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7"}
Sep 18 13:33:46.403676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:46.403516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" event={"ID":"3426464d-a5d9-4a99-a0b4-4d25d503968a","Type":"ContainerStarted","Data":"a6f0bc6d821d42c3da476a0b577fbac59a511c561c79396d263146c3631879cd"}
Sep 18 13:33:46.403676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:46.403659    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:46.427939 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:46.427889    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" podStartSLOduration=1.9927202830000001 podStartE2EDuration="2.427873769s" totalImagesPullingTime="435.153486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:33:46.425122896 +0000 UTC m=+1143.794382280" watchObservedRunningTime="2026-09-18 13:33:46.427873769 +0000 UTC m=+1143.797133196"
Sep 18 13:33:50.491039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:50.490996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:51.440262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:51.440218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:52.124750 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:52.124707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:52.227023 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:52.226983    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:52.415763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:52.415690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:33:53.213569 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:53.213520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:53.945919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:53.945855    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:54.767079 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:54.767039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:55.835139 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:55.835095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:56.816265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:56.816224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:57.811396 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:57.811343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:58.768234 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:58.768172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:59.507550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:59.507510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:33:59.602903 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:33:59.602861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:00.229811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:00.229779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:00.327242 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:00.327180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:00.568435 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:00.568396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:00.671835 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:00.671802    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:01.398083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:01.398045    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:02.244177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:02.244138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:02.983621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:02.983587    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"]
Sep 18 13:34:02.983836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:02.983811    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt" podUID="cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" containerName="maas-api" containerID="cri-o://19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6" gracePeriod=30
Sep 18 13:34:03.043655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.043619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:03.136378 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.136344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:03.215466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.215420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:03.254385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.254359    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:34:03.314827 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.314774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:03.398589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.398552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:03.420277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.420243    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-openshift-service-ca\") pod \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") "
Sep 18 13:34:03.420485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.420326    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk45v\" (UniqueName: \"kubernetes.io/projected/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-kube-api-access-jk45v\") pod \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") "
Sep 18 13:34:03.420485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.420367    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-metrics-certs\") pod \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") "
Sep 18 13:34:03.420485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.420389    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-maas-api-tls\") pod \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\" (UID: \"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555\") "
Sep 18 13:34:03.420728 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.420699    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" (UID: "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:34:03.420883 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.420862    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:03.423003 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.422961    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-kube-api-access-jk45v" (OuterVolumeSpecName: "kube-api-access-jk45v") pod "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" (UID: "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555"). InnerVolumeSpecName "kube-api-access-jk45v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:34:03.423152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.423017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" (UID: "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:34:03.423599 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.423573    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" (UID: "cf7a3c8f-dd79-4f41-a0fd-a2d545d20555"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:34:03.519992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.519905    2564 generic.go:356] "Generic (PLEG): container finished" podID="cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" containerID="19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6" exitCode=0
Sep 18 13:34:03.519992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.519951    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"
Sep 18 13:34:03.519992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.519969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt" event={"ID":"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555","Type":"ContainerDied","Data":"19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6"}
Sep 18 13:34:03.520236 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.520021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt" event={"ID":"cf7a3c8f-dd79-4f41-a0fd-a2d545d20555","Type":"ContainerDied","Data":"792e1356b5eecbd1c082fa14806cc6ff282b11d922179a884621186a4c83836e"}
Sep 18 13:34:03.520236 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.520052    2564 scope.go:117] "RemoveContainer" containerID="19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6"
Sep 18 13:34:03.521489 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.521467    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk45v\" (UniqueName: \"kubernetes.io/projected/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-kube-api-access-jk45v\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:03.521572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.521494    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:03.521572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.521508    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:03.530775 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.530758    2564 scope.go:117] "RemoveContainer" containerID="19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6"
Sep 18 13:34:03.531037 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:34:03.531018    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6\": container with ID starting with 19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6 not found: ID does not exist" containerID="19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6"
Sep 18 13:34:03.531106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.531044    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6"} err="failed to get container status \"19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6\": rpc error: code = NotFound desc = could not find container \"19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6\": container with ID starting with 19272de62c14d3cbfa8d842009eb00d4599c7086ef48d80cd7aeb6ac76d8a2e6 not found: ID does not exist"
Sep 18 13:34:03.547469 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.547439    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"]
Sep 18 13:34:03.551429 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.551389    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-808e44-57ccb5cc5-qdcrt"]
Sep 18 13:34:03.693679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.693647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:03.793645 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:03.793556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:04.754370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:04.754328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:05.216152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:05.216066    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" path="/var/lib/kubelet/pods/cf7a3c8f-dd79-4f41-a0fd-a2d545d20555/volumes"
Sep 18 13:34:05.849240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:05.849133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:07.052162 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:07.052124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:07.707183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:07.707145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:07.820604 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:07.820571    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:07.926384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:07.926349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:08.767317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:08.767280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:08.971992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:08.969401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:09.331446 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:09.331413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:10.183619 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:10.183579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:10.971579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:10.971529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:12.001336 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:12.001297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:12.788482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:12.788438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:13.649589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:13.649543    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:21.613355 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:21.613317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:22.266637 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.266602    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"]
Sep 18 13:34:22.266877 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.266851    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" podUID="3426464d-a5d9-4a99-a0b4-4d25d503968a" containerName="maas-api" containerID="cri-o://325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7" gracePeriod=30
Sep 18 13:34:22.292060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.291962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:22.402365 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.402324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:22.410495 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.410456    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" podUID="3426464d-a5d9-4a99-a0b4-4d25d503968a" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.78:8443/health\": dial tcp 10.132.0.78:8443: connect: connection refused"
Sep 18 13:34:22.497263 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.497229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:22.530513 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.530439    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:34:22.618761 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.618716    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3426464d-a5d9-4a99-a0b4-4d25d503968a-openshift-service-ca\") pod \"3426464d-a5d9-4a99-a0b4-4d25d503968a\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") "
Sep 18 13:34:22.618761 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.618760    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls\") pod \"3426464d-a5d9-4a99-a0b4-4d25d503968a\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") "
Sep 18 13:34:22.619308 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.618790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr9cw\" (UniqueName: \"kubernetes.io/projected/3426464d-a5d9-4a99-a0b4-4d25d503968a-kube-api-access-gr9cw\") pod \"3426464d-a5d9-4a99-a0b4-4d25d503968a\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") "
Sep 18 13:34:22.619308 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.618815    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-metrics-certs\") pod \"3426464d-a5d9-4a99-a0b4-4d25d503968a\" (UID: \"3426464d-a5d9-4a99-a0b4-4d25d503968a\") "
Sep 18 13:34:22.619700 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.619670    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3426464d-a5d9-4a99-a0b4-4d25d503968a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3426464d-a5d9-4a99-a0b4-4d25d503968a" (UID: "3426464d-a5d9-4a99-a0b4-4d25d503968a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:34:22.621591 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.621562    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3426464d-a5d9-4a99-a0b4-4d25d503968a" (UID: "3426464d-a5d9-4a99-a0b4-4d25d503968a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:34:22.621712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.621569    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3426464d-a5d9-4a99-a0b4-4d25d503968a" (UID: "3426464d-a5d9-4a99-a0b4-4d25d503968a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:34:22.621997 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.621976    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3426464d-a5d9-4a99-a0b4-4d25d503968a-kube-api-access-gr9cw" (OuterVolumeSpecName: "kube-api-access-gr9cw") pod "3426464d-a5d9-4a99-a0b4-4d25d503968a" (UID: "3426464d-a5d9-4a99-a0b4-4d25d503968a"). InnerVolumeSpecName "kube-api-access-gr9cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:34:22.633957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.633929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:22.644088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.644057    2564 generic.go:356] "Generic (PLEG): container finished" podID="3426464d-a5d9-4a99-a0b4-4d25d503968a" containerID="325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7" exitCode=0
Sep 18 13:34:22.644262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.644104    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"
Sep 18 13:34:22.644262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.644138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" event={"ID":"3426464d-a5d9-4a99-a0b4-4d25d503968a","Type":"ContainerDied","Data":"325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7"}
Sep 18 13:34:22.644262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.644219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6" event={"ID":"3426464d-a5d9-4a99-a0b4-4d25d503968a","Type":"ContainerDied","Data":"a6f0bc6d821d42c3da476a0b577fbac59a511c561c79396d263146c3631879cd"}
Sep 18 13:34:22.644262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.644226    2564 scope.go:117] "RemoveContainer" containerID="325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7"
Sep 18 13:34:22.656602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.656574    2564 scope.go:117] "RemoveContainer" containerID="325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7"
Sep 18 13:34:22.656954 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:34:22.656935    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7\": container with ID starting with 325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7 not found: ID does not exist" containerID="325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7"
Sep 18 13:34:22.657029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.656962    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7"} err="failed to get container status \"325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7\": rpc error: code = NotFound desc = could not find container \"325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7\": container with ID starting with 325201efa362f036e93d77ef2801d55c795aa8146af29ef18ca6505f6691bed7 not found: ID does not exist"
Sep 18 13:34:22.673461 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.673424    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"]
Sep 18 13:34:22.678608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.678572    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bb3ce27c-7b7997d99d-tqtk6"]
Sep 18 13:34:22.720854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.720814    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3426464d-a5d9-4a99-a0b4-4d25d503968a-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:22.720854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.720848    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:22.720854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.720857    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr9cw\" (UniqueName: \"kubernetes.io/projected/3426464d-a5d9-4a99-a0b4-4d25d503968a-kube-api-access-gr9cw\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:22.720854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.720865    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3426464d-a5d9-4a99-a0b4-4d25d503968a-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:34:22.741146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:22.741114    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:23.041423 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:23.041386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:23.216709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:23.216673    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3426464d-a5d9-4a99-a0b4-4d25d503968a" path="/var/lib/kubelet/pods/3426464d-a5d9-4a99-a0b4-4d25d503968a/volumes"
Sep 18 13:34:24.161244 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:24.161209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:25.299144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:25.299101    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:27.004337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:27.004298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:28.474122 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:28.474081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:29.618429 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:29.618396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:31.013434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:31.013396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:31.121126 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:31.121086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:31.360572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:31.360477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:31.730178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:31.730086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:31.835414 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:31.835368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:31.936468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:31.936433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:37.142379 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:37.142343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:38.518973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:38.518936    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:38.636505 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:38.636475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:38.766064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:38.766028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:38.934953 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:38.934858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:39.257035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:39.257004    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:43.192047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:43.192017    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:34:43.193564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:43.193537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:34:45.994296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:45.994262    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:46.147009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:46.146969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:46.799269 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:46.799225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:47.186595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:47.186507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:47.634440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:47.634401    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:47.928440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:47.928347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:48.210225 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:48.210109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:48.310685 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:48.310651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:48.701269 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:48.701232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:49.040121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:49.040083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:49.711531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:49.711487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:50.006980 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:50.006943    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:50.554629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:50.554584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:50.704696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:50.704664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:50.911395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:50.911300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:51.192575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:51.192495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:51.330320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:51.330270    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:51.573044 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:51.573014    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:52.897644 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:52.897610    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:54.398652 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:54.398605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:55.647571 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:55.647531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:56.863539 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.863504    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"]
Sep 18 13:34:56.864184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.864162    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" containerName="maas-api"
Sep 18 13:34:56.864184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.864187    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" containerName="maas-api"
Sep 18 13:34:56.864368 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.864239    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3426464d-a5d9-4a99-a0b4-4d25d503968a" containerName="maas-api"
Sep 18 13:34:56.864368 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.864248    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3426464d-a5d9-4a99-a0b4-4d25d503968a" containerName="maas-api"
Sep 18 13:34:56.864475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.864405    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7a3c8f-dd79-4f41-a0fd-a2d545d20555" containerName="maas-api"
Sep 18 13:34:56.864475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.864424    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3426464d-a5d9-4a99-a0b4-4d25d503968a" containerName="maas-api"
Sep 18 13:34:56.869262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.869236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:56.873089 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.873067    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-b2d5da-serving-cert\""
Sep 18 13:34:56.892484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.892457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"]
Sep 18 13:34:56.959624 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.959587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:56.977854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.977819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419ebfc5-6dea-4e40-9b12-28b433d11ff8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:56.978069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.977891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:56.978069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.977965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j54s\" (UniqueName: \"kubernetes.io/projected/419ebfc5-6dea-4e40-9b12-28b433d11ff8-kube-api-access-5j54s\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:56.978069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:56.978009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.078911 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.078875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419ebfc5-6dea-4e40-9b12-28b433d11ff8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.079092 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.078921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.079092 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.078976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j54s\" (UniqueName: \"kubernetes.io/projected/419ebfc5-6dea-4e40-9b12-28b433d11ff8-kube-api-access-5j54s\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.079092 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.079015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.079234 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:34:57.079114    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-serving-cert: secret "maas-api-e2e-shared-a-w2-b2d5da-serving-cert" not found
Sep 18 13:34:57.079234 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:34:57.079215    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls podName:419ebfc5-6dea-4e40-9b12-28b433d11ff8 nodeName:}" failed. No retries permitted until 2026-09-18 13:34:57.579180655 +0000 UTC m=+1214.948440031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls") pod "maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" (UID: "419ebfc5-6dea-4e40-9b12-28b433d11ff8") : secret "maas-api-e2e-shared-a-w2-b2d5da-serving-cert" not found
Sep 18 13:34:57.079618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.079596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419ebfc5-6dea-4e40-9b12-28b433d11ff8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.081551 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.081532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.109272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.109240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j54s\" (UniqueName: \"kubernetes.io/projected/419ebfc5-6dea-4e40-9b12-28b433d11ff8-kube-api-access-5j54s\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.194648 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.194557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:57.559322 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.559284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:57.584896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.584862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.587375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.587345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.780645 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.780611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:57.905561 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:57.905523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:58.084920 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:58.084892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"]
Sep 18 13:34:58.087390 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:34:58.087360    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419ebfc5_6dea_4e40_9b12_28b433d11ff8.slice/crio-04de00f231b6866d218158b3aaa81fdf86522b9ae16a61bce24a6545a12b0179 WatchSource:0}: Error finding container 04de00f231b6866d218158b3aaa81fdf86522b9ae16a61bce24a6545a12b0179: Status 404 returned error can't find the container with id 04de00f231b6866d218158b3aaa81fdf86522b9ae16a61bce24a6545a12b0179
Sep 18 13:34:58.124602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:58.124552    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:34:58.886743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:58.886699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" event={"ID":"419ebfc5-6dea-4e40-9b12-28b433d11ff8","Type":"ContainerStarted","Data":"825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac"}
Sep 18 13:34:58.886916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:58.886765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" event={"ID":"419ebfc5-6dea-4e40-9b12-28b433d11ff8","Type":"ContainerStarted","Data":"04de00f231b6866d218158b3aaa81fdf86522b9ae16a61bce24a6545a12b0179"}
Sep 18 13:34:58.886916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:58.886794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:34:58.909167 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:34:58.909117    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" podStartSLOduration=2.545501637 podStartE2EDuration="2.909101644s" totalImagesPullingTime="363.600007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:34:58.90854331 +0000 UTC m=+1216.277802692" watchObservedRunningTime="2026-09-18 13:34:58.909101644 +0000 UTC m=+1216.278361026"
Sep 18 13:35:04.899660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:04.899627    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:35:20.603116 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:20.603071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:21.967579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:21.967544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:22.104391 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:22.104350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:22.200324 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:22.200277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:23.031769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:23.031729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:24.052834 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:24.052793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:24.592532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:24.592496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:24.737509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:24.737467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:25.431554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:25.431518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:26.829381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:26.829341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:28.259062 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.259020    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"]
Sep 18 13:35:28.263508 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.263478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.267164 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.267138    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-92b54f-serving-cert\""
Sep 18 13:35:28.286468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.286431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"]
Sep 18 13:35:28.310207 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.310150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38c6890b-942a-4e42-95ba-129771debc17-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.310384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.310302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.310384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.310375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d6hx\" (UniqueName: \"kubernetes.io/projected/38c6890b-942a-4e42-95ba-129771debc17-kube-api-access-5d6hx\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.310521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.310499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.313063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.313032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:28.396132 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.396093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:28.411343 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.411304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.411525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.411359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38c6890b-942a-4e42-95ba-129771debc17-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.411525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.411417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.411525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.411464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d6hx\" (UniqueName: \"kubernetes.io/projected/38c6890b-942a-4e42-95ba-129771debc17-kube-api-access-5d6hx\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.411701 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:35:28.411575    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-serving-cert: secret "maas-api-e2e-shared-b-w2-92b54f-serving-cert" not found
Sep 18 13:35:28.411701 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:35:28.411664    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls podName:38c6890b-942a-4e42-95ba-129771debc17 nodeName:}" failed. No retries permitted until 2026-09-18 13:35:28.911640283 +0000 UTC m=+1246.280899658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls") pod "maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" (UID: "38c6890b-942a-4e42-95ba-129771debc17") : secret "maas-api-e2e-shared-b-w2-92b54f-serving-cert" not found
Sep 18 13:35:28.412143 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.412122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38c6890b-942a-4e42-95ba-129771debc17-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.413922 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.413902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.422269 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.422245    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d6hx\" (UniqueName: \"kubernetes.io/projected/38c6890b-942a-4e42-95ba-129771debc17-kube-api-access-5d6hx\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.609620 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.609516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:28.867025 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.866932    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:28.917247 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.917206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.919643 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.919614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:28.987255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:28.987185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:29.183317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:29.183224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:29.460319 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:29.460227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:29.469390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:29.469357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"]
Sep 18 13:35:29.469861 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:35:29.469836    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c6890b_942a_4e42_95ba_129771debc17.slice/crio-5a44a82edc40dd6edf3fcbad7a9d328d9d54b8a02139fd1f15b7cfb241291373 WatchSource:0}: Error finding container 5a44a82edc40dd6edf3fcbad7a9d328d9d54b8a02139fd1f15b7cfb241291373: Status 404 returned error can't find the container with id 5a44a82edc40dd6edf3fcbad7a9d328d9d54b8a02139fd1f15b7cfb241291373
Sep 18 13:35:29.471126 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:29.471107    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:35:30.087072 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:30.087032    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" event={"ID":"38c6890b-942a-4e42-95ba-129771debc17","Type":"ContainerStarted","Data":"e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116"}
Sep 18 13:35:30.087296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:30.087101    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:30.087296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:30.087122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" event={"ID":"38c6890b-942a-4e42-95ba-129771debc17","Type":"ContainerStarted","Data":"5a44a82edc40dd6edf3fcbad7a9d328d9d54b8a02139fd1f15b7cfb241291373"}
Sep 18 13:35:30.113825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:30.113743    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" podStartSLOduration=1.701101429 podStartE2EDuration="2.113726285s" totalImagesPullingTime="412.624856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:35:30.111830087 +0000 UTC m=+1247.481089470" watchObservedRunningTime="2026-09-18 13:35:30.113726285 +0000 UTC m=+1247.482985708"
Sep 18 13:35:30.362933 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:30.362894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:31.596328 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:31.596280    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:32.630553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:32.630517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:36.098482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:36.098410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:35:37.271919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:37.271886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:43.293057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:43.293028    2564 scope.go:117] "RemoveContainer" containerID="c5489ca787f8cd1f10f2d23eb67e48e55a5a35c1bd620f97fd56193b44387b64"
Sep 18 13:35:49.549796 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:49.549761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:52.288095 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:52.288060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:53.700096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:53.700055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:54.874060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:54.874010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:55.101908 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.101863    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:55.862907 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.862869    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7466-0580fa"]
Sep 18 13:35:55.868092 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.868069    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:35:55.876493 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.876472    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncnrt\""
Sep 18 13:35:55.877533 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.877514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm886\" (UniqueName: \"kubernetes.io/projected/a3b608ae-da00-4504-906f-5da445e2b837-kube-api-access-bm886\") pod \"test-curl-7466-0580fa\" (UID: \"a3b608ae-da00-4504-906f-5da445e2b837\") " pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:35:55.911366 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.911328    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-0580fa"]
Sep 18 13:35:55.978420 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:55.978384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm886\" (UniqueName: \"kubernetes.io/projected/a3b608ae-da00-4504-906f-5da445e2b837-kube-api-access-bm886\") pod \"test-curl-7466-0580fa\" (UID: \"a3b608ae-da00-4504-906f-5da445e2b837\") " pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:35:56.036179 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:56.036146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm886\" (UniqueName: \"kubernetes.io/projected/a3b608ae-da00-4504-906f-5da445e2b837-kube-api-access-bm886\") pod \"test-curl-7466-0580fa\" (UID: \"a3b608ae-da00-4504-906f-5da445e2b837\") " pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:35:56.177438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:56.177331    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:35:56.484180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:56.484152    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-0580fa"]
Sep 18 13:35:56.484334 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:35:56.484204    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3b608ae_da00_4504_906f_5da445e2b837.slice/crio-856b9516f48aa74233d914a8eaaa7e9e69ab01a02f21751add3037562bf6f37a WatchSource:0}: Error finding container 856b9516f48aa74233d914a8eaaa7e9e69ab01a02f21751add3037562bf6f37a: Status 404 returned error can't find the container with id 856b9516f48aa74233d914a8eaaa7e9e69ab01a02f21751add3037562bf6f37a
Sep 18 13:35:57.090010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:57.089977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:57.264743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:57.264705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-0580fa" event={"ID":"a3b608ae-da00-4504-906f-5da445e2b837","Type":"ContainerStarted","Data":"b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70"}
Sep 18 13:35:57.264743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:57.264748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-0580fa" event={"ID":"a3b608ae-da00-4504-906f-5da445e2b837","Type":"ContainerStarted","Data":"856b9516f48aa74233d914a8eaaa7e9e69ab01a02f21751add3037562bf6f37a"}
Sep 18 13:35:57.297279 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:57.297225    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7466-0580fa" podStartSLOduration=2.297208388 podStartE2EDuration="2.297208388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:35:57.295564744 +0000 UTC m=+1274.664824127" watchObservedRunningTime="2026-09-18 13:35:57.297208388 +0000 UTC m=+1274.666467760"
Sep 18 13:35:58.375349 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.375263    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7466-0580fa"]
Sep 18 13:35:58.397697 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.397662    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7466-0580fa"]
Sep 18 13:35:58.575807 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.575775    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7466-1a4a83"]
Sep 18 13:35:58.576271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.576257    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b608ae-da00-4504-906f-5da445e2b837" containerName="test-curl-7466-0580fa"
Sep 18 13:35:58.576271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.576272    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b608ae-da00-4504-906f-5da445e2b837" containerName="test-curl-7466-0580fa"
Sep 18 13:35:58.576375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.576366    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b608ae-da00-4504-906f-5da445e2b837" containerName="test-curl-7466-0580fa"
Sep 18 13:35:58.579803 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.579787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:35:58.600544 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.600514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-1a4a83"]
Sep 18 13:35:58.606711 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.606683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmr4\" (UniqueName: \"kubernetes.io/projected/067b2fc9-1eea-42c5-a643-f1ca178beb95-kube-api-access-nlmr4\") pod \"test-curl-7466-1a4a83\" (UID: \"067b2fc9-1eea-42c5-a643-f1ca178beb95\") " pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:35:58.707902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.707801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmr4\" (UniqueName: \"kubernetes.io/projected/067b2fc9-1eea-42c5-a643-f1ca178beb95-kube-api-access-nlmr4\") pod \"test-curl-7466-1a4a83\" (UID: \"067b2fc9-1eea-42c5-a643-f1ca178beb95\") " pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:35:58.738469 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.738437    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmr4\" (UniqueName: \"kubernetes.io/projected/067b2fc9-1eea-42c5-a643-f1ca178beb95-kube-api-access-nlmr4\") pod \"test-curl-7466-1a4a83\" (UID: \"067b2fc9-1eea-42c5-a643-f1ca178beb95\") " pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:35:58.888983 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.888945    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:35:58.927936 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:58.927897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:35:59.197100 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:59.197072    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-1a4a83"]
Sep 18 13:35:59.198276 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:35:59.198250    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod067b2fc9_1eea_42c5_a643_f1ca178beb95.slice/crio-31d851420cb6a26136de7b826b373828d3c32e6367003c0f2df893d5aee068ea WatchSource:0}: Error finding container 31d851420cb6a26136de7b826b373828d3c32e6367003c0f2df893d5aee068ea: Status 404 returned error can't find the container with id 31d851420cb6a26136de7b826b373828d3c32e6367003c0f2df893d5aee068ea
Sep 18 13:35:59.278778 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:59.278747    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-1a4a83" event={"ID":"067b2fc9-1eea-42c5-a643-f1ca178beb95","Type":"ContainerStarted","Data":"c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5"}
Sep 18 13:35:59.278948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:59.278789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-1a4a83" event={"ID":"067b2fc9-1eea-42c5-a643-f1ca178beb95","Type":"ContainerStarted","Data":"31d851420cb6a26136de7b826b373828d3c32e6367003c0f2df893d5aee068ea"}
Sep 18 13:35:59.278948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:59.278820    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7466-0580fa" podUID="a3b608ae-da00-4504-906f-5da445e2b837" containerName="test-curl-7466-0580fa" containerID="cri-o://b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70" gracePeriod=2
Sep 18 13:35:59.319455 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:35:59.319397    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7466-1a4a83" podStartSLOduration=1.319380703 podStartE2EDuration="1.319380703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:35:59.316643461 +0000 UTC m=+1276.685902843" watchObservedRunningTime="2026-09-18 13:35:59.319380703 +0000 UTC m=+1276.688640122"
Sep 18 13:36:00.406438 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.406339    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7466-1a4a83"]
Sep 18 13:36:00.418568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.418534    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7466-1a4a83"]
Sep 18 13:36:00.546115 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.546074    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7466-472728"]
Sep 18 13:36:00.546869 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.546841    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067b2fc9-1eea-42c5-a643-f1ca178beb95" containerName="test-curl-7466-1a4a83"
Sep 18 13:36:00.546869 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.546868    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="067b2fc9-1eea-42c5-a643-f1ca178beb95" containerName="test-curl-7466-1a4a83"
Sep 18 13:36:00.547040 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.547015    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="067b2fc9-1eea-42c5-a643-f1ca178beb95" containerName="test-curl-7466-1a4a83"
Sep 18 13:36:00.550842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.550816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:00.564142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.564015    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-472728"]
Sep 18 13:36:00.628382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.628349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5db\" (UniqueName: \"kubernetes.io/projected/43680295-3046-4fb9-afdd-47126f2798db-kube-api-access-5s5db\") pod \"test-curl-7466-472728\" (UID: \"43680295-3046-4fb9-afdd-47126f2798db\") " pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:00.729354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.729257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5db\" (UniqueName: \"kubernetes.io/projected/43680295-3046-4fb9-afdd-47126f2798db-kube-api-access-5s5db\") pod \"test-curl-7466-472728\" (UID: \"43680295-3046-4fb9-afdd-47126f2798db\") " pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:00.755161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.755135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5db\" (UniqueName: \"kubernetes.io/projected/43680295-3046-4fb9-afdd-47126f2798db-kube-api-access-5s5db\") pod \"test-curl-7466-472728\" (UID: \"43680295-3046-4fb9-afdd-47126f2798db\") " pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:00.806235 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.806181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:00.864497 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:00.864459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:01.155413 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:36:01.155383    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43680295_3046_4fb9_afdd_47126f2798db.slice/crio-26b1b304102f3302e7feb7d9314b4ef58caa8181016cc9441b6b66ce0e4c28b3 WatchSource:0}: Error finding container 26b1b304102f3302e7feb7d9314b4ef58caa8181016cc9441b6b66ce0e4c28b3: Status 404 returned error can't find the container with id 26b1b304102f3302e7feb7d9314b4ef58caa8181016cc9441b6b66ce0e4c28b3
Sep 18 13:36:01.155579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.155555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-472728"]
Sep 18 13:36:01.301042 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.301000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-472728" event={"ID":"43680295-3046-4fb9-afdd-47126f2798db","Type":"ContainerStarted","Data":"0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202"}
Sep 18 13:36:01.301227 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.301051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-472728" event={"ID":"43680295-3046-4fb9-afdd-47126f2798db","Type":"ContainerStarted","Data":"26b1b304102f3302e7feb7d9314b4ef58caa8181016cc9441b6b66ce0e4c28b3"}
Sep 18 13:36:01.301283 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.301228    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7466-1a4a83" podUID="067b2fc9-1eea-42c5-a643-f1ca178beb95" containerName="test-curl-7466-1a4a83" containerID="cri-o://c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5" gracePeriod=2
Sep 18 13:36:01.458043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.458017    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:36:01.537813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.537772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm886\" (UniqueName: \"kubernetes.io/projected/a3b608ae-da00-4504-906f-5da445e2b837-kube-api-access-bm886\") pod \"a3b608ae-da00-4504-906f-5da445e2b837\" (UID: \"a3b608ae-da00-4504-906f-5da445e2b837\") "
Sep 18 13:36:01.539870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.539838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b608ae-da00-4504-906f-5da445e2b837-kube-api-access-bm886" (OuterVolumeSpecName: "kube-api-access-bm886") pod "a3b608ae-da00-4504-906f-5da445e2b837" (UID: "a3b608ae-da00-4504-906f-5da445e2b837"). InnerVolumeSpecName "kube-api-access-bm886". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:01.639075 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.639041    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm886\" (UniqueName: \"kubernetes.io/projected/a3b608ae-da00-4504-906f-5da445e2b837-kube-api-access-bm886\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:01.793856 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:01.793820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:02.310143 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.310111    2564 generic.go:356] "Generic (PLEG): container finished" podID="a3b608ae-da00-4504-906f-5da445e2b837" containerID="b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70" exitCode=137
Sep 18 13:36:02.310311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.310171    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:36:02.310311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.310227    2564 scope.go:117] "RemoveContainer" containerID="b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70"
Sep 18 13:36:02.320069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.320049    2564 scope.go:117] "RemoveContainer" containerID="b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70"
Sep 18 13:36:02.320439 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:02.320412    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70\": container with ID starting with b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70 not found: ID does not exist" containerID="b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70"
Sep 18 13:36:02.320519 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.320451    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70"} err="failed to get container status \"b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70\": rpc error: code = NotFound desc = could not find container \"b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70\": container with ID starting with b9cb909a36210f6a96a34c069796bfbd3cc5f94e0aa785037beb68f5242aaf70 not found: ID does not exist"
Sep 18 13:36:02.324351 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:02.324324    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-0580fa\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="a3b608ae-da00-4504-906f-5da445e2b837" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:36:02.437613 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.437556    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7466-472728" podStartSLOduration=2.437538522 podStartE2EDuration="2.437538522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:36:01.359682851 +0000 UTC m=+1278.728942234" watchObservedRunningTime="2026-09-18 13:36:02.437538522 +0000 UTC m=+1279.806797910"
Sep 18 13:36:02.438760 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.438735    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7466-472728"]
Sep 18 13:36:02.445511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.445479    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7466-472728"]
Sep 18 13:36:02.605321 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.605229    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7466-448170"]
Sep 18 13:36:02.605764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.605749    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43680295-3046-4fb9-afdd-47126f2798db" containerName="test-curl-7466-472728"
Sep 18 13:36:02.605764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.605765    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="43680295-3046-4fb9-afdd-47126f2798db" containerName="test-curl-7466-472728"
Sep 18 13:36:02.605851 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.605843    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="43680295-3046-4fb9-afdd-47126f2798db" containerName="test-curl-7466-472728"
Sep 18 13:36:02.610454 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.610437    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:02.639453 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.639418    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-448170"]
Sep 18 13:36:02.649891 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.649868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2c2l\" (UniqueName: \"kubernetes.io/projected/527661d3-fb02-4af6-b3a6-4b1ab665b1f5-kube-api-access-z2c2l\") pod \"test-curl-7466-448170\" (UID: \"527661d3-fb02-4af6-b3a6-4b1ab665b1f5\") " pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:02.662187 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:02.662148    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-0580fa\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="a3b608ae-da00-4504-906f-5da445e2b837" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:36:02.743748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.743713    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:02.750723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.750697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2c2l\" (UniqueName: \"kubernetes.io/projected/527661d3-fb02-4af6-b3a6-4b1ab665b1f5-kube-api-access-z2c2l\") pod \"test-curl-7466-448170\" (UID: \"527661d3-fb02-4af6-b3a6-4b1ab665b1f5\") " pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:02.765671 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.765646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2c2l\" (UniqueName: \"kubernetes.io/projected/527661d3-fb02-4af6-b3a6-4b1ab665b1f5-kube-api-access-z2c2l\") pod \"test-curl-7466-448170\" (UID: \"527661d3-fb02-4af6-b3a6-4b1ab665b1f5\") " pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:02.920029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:02.919956    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:03.215529 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:03.215444    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-0580fa\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="a3b608ae-da00-4504-906f-5da445e2b837" pod="opendatahub/test-curl-7466-0580fa"
Sep 18 13:36:03.217312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.217290    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3b608ae-da00-4504-906f-5da445e2b837" path="/var/lib/kubelet/pods/a3b608ae-da00-4504-906f-5da445e2b837/volumes"
Sep 18 13:36:03.230253 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.230224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7466-448170"]
Sep 18 13:36:03.243852 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:36:03.243821    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod527661d3_fb02_4af6_b3a6_4b1ab665b1f5.slice/crio-4c27f258c8ee90025c3503ec210c6ace7729fb8794a81f9c8788391896d738af WatchSource:0}: Error finding container 4c27f258c8ee90025c3503ec210c6ace7729fb8794a81f9c8788391896d738af: Status 404 returned error can't find the container with id 4c27f258c8ee90025c3503ec210c6ace7729fb8794a81f9c8788391896d738af
Sep 18 13:36:03.318955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.318919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-448170" event={"ID":"527661d3-fb02-4af6-b3a6-4b1ab665b1f5","Type":"ContainerStarted","Data":"4c27f258c8ee90025c3503ec210c6ace7729fb8794a81f9c8788391896d738af"}
Sep 18 13:36:03.320205 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.320167    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7466-472728" podUID="43680295-3046-4fb9-afdd-47126f2798db" containerName="test-curl-7466-472728" containerID="cri-o://0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202" gracePeriod=2
Sep 18 13:36:03.470609 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.470547    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:36:03.558152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.558114    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlmr4\" (UniqueName: \"kubernetes.io/projected/067b2fc9-1eea-42c5-a643-f1ca178beb95-kube-api-access-nlmr4\") pod \"067b2fc9-1eea-42c5-a643-f1ca178beb95\" (UID: \"067b2fc9-1eea-42c5-a643-f1ca178beb95\") "
Sep 18 13:36:03.560152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.560130    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067b2fc9-1eea-42c5-a643-f1ca178beb95-kube-api-access-nlmr4" (OuterVolumeSpecName: "kube-api-access-nlmr4") pod "067b2fc9-1eea-42c5-a643-f1ca178beb95" (UID: "067b2fc9-1eea-42c5-a643-f1ca178beb95"). InnerVolumeSpecName "kube-api-access-nlmr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:03.659555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:03.659513    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlmr4\" (UniqueName: \"kubernetes.io/projected/067b2fc9-1eea-42c5-a643-f1ca178beb95-kube-api-access-nlmr4\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:04.131287 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.131185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:04.328490 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.328453    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7466-448170" event={"ID":"527661d3-fb02-4af6-b3a6-4b1ab665b1f5","Type":"ContainerStarted","Data":"1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277"}
Sep 18 13:36:04.329847 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.329821    2564 generic.go:356] "Generic (PLEG): container finished" podID="067b2fc9-1eea-42c5-a643-f1ca178beb95" containerID="c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5" exitCode=137
Sep 18 13:36:04.329983 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.329856    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:36:04.329983 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.329912    2564 scope.go:117] "RemoveContainer" containerID="c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5"
Sep 18 13:36:04.340266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.340247    2564 scope.go:117] "RemoveContainer" containerID="c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5"
Sep 18 13:36:04.340569 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:04.340546    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5\": container with ID starting with c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5 not found: ID does not exist" containerID="c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5"
Sep 18 13:36:04.340662 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.340576    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5"} err="failed to get container status \"c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5\": rpc error: code = NotFound desc = could not find container \"c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5\": container with ID starting with c21b52291755d0d25fa6a712ad3e8c61ff162adc61d4136dab7c638cefe8ece5 not found: ID does not exist"
Sep 18 13:36:04.374857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:04.374802    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7466-448170" podStartSLOduration=2.374782373 podStartE2EDuration="2.374782373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:36:04.372385253 +0000 UTC m=+1281.741644636" watchObservedRunningTime="2026-09-18 13:36:04.374782373 +0000 UTC m=+1281.744041756"
Sep 18 13:36:04.376348 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:04.376318    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-1a4a83\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="067b2fc9-1eea-42c5-a643-f1ca178beb95" pod="opendatahub/test-curl-7466-1a4a83"
Sep 18 13:36:05.174670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.174609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:05.215597 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.215566    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="067b2fc9-1eea-42c5-a643-f1ca178beb95" path="/var/lib/kubelet/pods/067b2fc9-1eea-42c5-a643-f1ca178beb95/volumes"
Sep 18 13:36:05.560963 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.560937    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:05.653841 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.653800    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7466-448170"]
Sep 18 13:36:05.667029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.666995    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7466-448170"]
Sep 18 13:36:05.677770 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.677732    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s5db\" (UniqueName: \"kubernetes.io/projected/43680295-3046-4fb9-afdd-47126f2798db-kube-api-access-5s5db\") pod \"43680295-3046-4fb9-afdd-47126f2798db\" (UID: \"43680295-3046-4fb9-afdd-47126f2798db\") "
Sep 18 13:36:05.680149 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.680115    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43680295-3046-4fb9-afdd-47126f2798db-kube-api-access-5s5db" (OuterVolumeSpecName: "kube-api-access-5s5db") pod "43680295-3046-4fb9-afdd-47126f2798db" (UID: "43680295-3046-4fb9-afdd-47126f2798db"). InnerVolumeSpecName "kube-api-access-5s5db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:05.778866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:05.778829    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s5db\" (UniqueName: \"kubernetes.io/projected/43680295-3046-4fb9-afdd-47126f2798db-kube-api-access-5s5db\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:06.239511 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.239457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:06.345436 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.345401    2564 generic.go:356] "Generic (PLEG): container finished" podID="43680295-3046-4fb9-afdd-47126f2798db" containerID="0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202" exitCode=137
Sep 18 13:36:06.345614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.345447    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:06.345614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.345506    2564 scope.go:117] "RemoveContainer" containerID="0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202"
Sep 18 13:36:06.345756 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.345680    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7466-448170" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" containerName="test-curl-7466-448170" containerID="cri-o://1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277" gracePeriod=2
Sep 18 13:36:06.348817 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:06.348780    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-448170\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:06.355400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.355382    2564 scope.go:117] "RemoveContainer" containerID="0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202"
Sep 18 13:36:06.355672 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:06.355637    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202\": container with ID starting with 0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202 not found: ID does not exist" containerID="0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202"
Sep 18 13:36:06.355741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.355677    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202"} err="failed to get container status \"0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202\": rpc error: code = NotFound desc = could not find container \"0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202\": container with ID starting with 0046596d05141e41e660f390121cb7bc186408bbc45ad3d33eb4af774e945202 not found: ID does not exist"
Sep 18 13:36:06.363443 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:06.363413    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-448170\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:06.366004 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:06.365982    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-448170\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:06.368555 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:06.368531    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7466-472728\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="43680295-3046-4fb9-afdd-47126f2798db" pod="opendatahub/test-curl-7466-472728"
Sep 18 13:36:06.430972 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.430940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:06.628178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:06.628095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:07.048342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:07.048309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:07.206987 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:07.206947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:07.215919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:07.215890    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43680295-3046-4fb9-afdd-47126f2798db" path="/var/lib/kubelet/pods/43680295-3046-4fb9-afdd-47126f2798db/volumes"
Sep 18 13:36:07.691807 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:07.691770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:08.535783 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:08.535750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:08.610399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:08.610310    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2c2l\" (UniqueName: \"kubernetes.io/projected/527661d3-fb02-4af6-b3a6-4b1ab665b1f5-kube-api-access-z2c2l\") pod \"527661d3-fb02-4af6-b3a6-4b1ab665b1f5\" (UID: \"527661d3-fb02-4af6-b3a6-4b1ab665b1f5\") "
Sep 18 13:36:08.612489 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:08.612459    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527661d3-fb02-4af6-b3a6-4b1ab665b1f5-kube-api-access-z2c2l" (OuterVolumeSpecName: "kube-api-access-z2c2l") pod "527661d3-fb02-4af6-b3a6-4b1ab665b1f5" (UID: "527661d3-fb02-4af6-b3a6-4b1ab665b1f5"). InnerVolumeSpecName "kube-api-access-z2c2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:08.711921 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:08.711879    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2c2l\" (UniqueName: \"kubernetes.io/projected/527661d3-fb02-4af6-b3a6-4b1ab665b1f5-kube-api-access-z2c2l\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:09.216259 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.216228    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" path="/var/lib/kubelet/pods/527661d3-fb02-4af6-b3a6-4b1ab665b1f5/volumes"
Sep 18 13:36:09.268872 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.268842    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:09.366855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.366822    2564 generic.go:356] "Generic (PLEG): container finished" podID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" containerID="1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277" exitCode=137
Sep 18 13:36:09.367040 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.366864    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7466-448170"
Sep 18 13:36:09.367040 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.366920    2564 scope.go:117] "RemoveContainer" containerID="1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277"
Sep 18 13:36:09.376138 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.376108    2564 scope.go:117] "RemoveContainer" containerID="1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277"
Sep 18 13:36:09.376426 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:09.376406    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277\": container with ID starting with 1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277 not found: ID does not exist" containerID="1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277"
Sep 18 13:36:09.376485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:09.376435    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277"} err="failed to get container status \"1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277\": rpc error: code = NotFound desc = could not find container \"1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277\": container with ID starting with 1aa70414c046ff72abca8fddc8f734f54fcdff7d5804d654e8bcc75e81b24277 not found: ID does not exist"
Sep 18 13:36:10.162557 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:10.162519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:10.278485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:10.278451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:10.501533 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:10.501496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:11.731056 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:11.731017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:12.788810 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:12.788776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:13.992121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:13.992089    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"]
Sep 18 13:36:13.992713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:13.992693    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" containerName="test-curl-7466-448170"
Sep 18 13:36:13.992794 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:13.992716    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" containerName="test-curl-7466-448170"
Sep 18 13:36:13.992835 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:13.992824    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="527661d3-fb02-4af6-b3a6-4b1ab665b1f5" containerName="test-curl-7466-448170"
Sep 18 13:36:13.995936 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:13.995921    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.001798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.001778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fa9905fd-serving-cert\""
Sep 18 13:36:14.021444 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.021419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"]
Sep 18 13:36:14.070961 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.070931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-openshift-service-ca\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.071112 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.070971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-maas-api-tls\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.071112 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.070991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-metrics-certs\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.071112 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.071022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5hbx\" (UniqueName: \"kubernetes.io/projected/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-kube-api-access-n5hbx\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.172165 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.172126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5hbx\" (UniqueName: \"kubernetes.io/projected/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-kube-api-access-n5hbx\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.172387 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.172371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-openshift-service-ca\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.172457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.172403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-maas-api-tls\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.172457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.172431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-metrics-certs\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.173079 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.173059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-openshift-service-ca\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.174971 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.174938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-maas-api-tls\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.175086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.174975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-metrics-certs\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.183064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.183033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5hbx\" (UniqueName: \"kubernetes.io/projected/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-kube-api-access-n5hbx\") pod \"maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.220772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.220720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:14.306937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.306832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:14.400603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.400569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:14.619104 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.619078    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"]
Sep 18 13:36:14.621821 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:36:14.621794    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce86db9b_d30c_4f30_bb5b_cb4df91d6d90.slice/crio-2df34ed6f5453d11e2d66aee2d58c4bc289c9b6c40bfd47294ea4e0afbafa0ab WatchSource:0}: Error finding container 2df34ed6f5453d11e2d66aee2d58c4bc289c9b6c40bfd47294ea4e0afbafa0ab: Status 404 returned error can't find the container with id 2df34ed6f5453d11e2d66aee2d58c4bc289c9b6c40bfd47294ea4e0afbafa0ab
Sep 18 13:36:14.973271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:14.973161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:15.208526 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:15.208490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:15.410068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:15.410035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l" event={"ID":"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90","Type":"ContainerStarted","Data":"3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5"}
Sep 18 13:36:15.410237 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:15.410085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l" event={"ID":"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90","Type":"ContainerStarted","Data":"2df34ed6f5453d11e2d66aee2d58c4bc289c9b6c40bfd47294ea4e0afbafa0ab"}
Sep 18 13:36:15.410237 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:15.410108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:15.446213 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:15.446140    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l" podStartSLOduration=2.024466309 podStartE2EDuration="2.446123916s" totalImagesPullingTime="421.657607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:36:15.441163649 +0000 UTC m=+1292.810423034" watchObservedRunningTime="2026-09-18 13:36:15.446123916 +0000 UTC m=+1292.815383298"
Sep 18 13:36:15.894744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:15.894701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:16.988820 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:16.988778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:18.081098 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.081058    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"]
Sep 18 13:36:18.081546 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.081321    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz" podUID="056a999d-76c5-4984-b1fb-75ea5fbb62e0" containerName="maas-api" containerID="cri-o://d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2" gracePeriod=30
Sep 18 13:36:18.122517 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.122477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:18.257812 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.257778    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"]
Sep 18 13:36:18.258068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.258032    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd" podUID="29096b2e-34e3-468f-a65f-2d6716e99c35" containerName="payload-pre-processing" containerID="cri-o://dd7007c87a58068f7de851ad830221bf62624d0f99b4ad8569a797c0cf191585" gracePeriod=30
Sep 18 13:36:18.392940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.392914    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:36:18.432572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.432487    2564 generic.go:356] "Generic (PLEG): container finished" podID="056a999d-76c5-4984-b1fb-75ea5fbb62e0" containerID="d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2" exitCode=0
Sep 18 13:36:18.432572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.432544    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"
Sep 18 13:36:18.432838 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.432624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz" event={"ID":"056a999d-76c5-4984-b1fb-75ea5fbb62e0","Type":"ContainerDied","Data":"d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2"}
Sep 18 13:36:18.432838 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.432669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz" event={"ID":"056a999d-76c5-4984-b1fb-75ea5fbb62e0","Type":"ContainerDied","Data":"00cb9c15e08b106d2e871da362e31b0532cd1a97aceea24b8491cbd9893a140a"}
Sep 18 13:36:18.432838 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.432696    2564 scope.go:117] "RemoveContainer" containerID="d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2"
Sep 18 13:36:18.435401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.435282    2564 generic.go:356] "Generic (PLEG): container finished" podID="29096b2e-34e3-468f-a65f-2d6716e99c35" containerID="dd7007c87a58068f7de851ad830221bf62624d0f99b4ad8569a797c0cf191585" exitCode=0
Sep 18 13:36:18.435401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.435320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd" event={"ID":"29096b2e-34e3-468f-a65f-2d6716e99c35","Type":"ContainerDied","Data":"dd7007c87a58068f7de851ad830221bf62624d0f99b4ad8569a797c0cf191585"}
Sep 18 13:36:18.447504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.447437    2564 scope.go:117] "RemoveContainer" containerID="d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2"
Sep 18 13:36:18.449355 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:18.449239    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2\": container with ID starting with d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2 not found: ID does not exist" containerID="d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2"
Sep 18 13:36:18.449355 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.449285    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2"} err="failed to get container status \"d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2\": rpc error: code = NotFound desc = could not find container \"d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2\": container with ID starting with d81fdc37c3956e4bd45d8347b931f3ac53b81768ad7b4b678b23b6c3e6b9e9a2 not found: ID does not exist"
Sep 18 13:36:18.491311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.491274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:18.519597 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.519572    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-maas-api-tls\") pod \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") "
Sep 18 13:36:18.519755 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.519669    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/056a999d-76c5-4984-b1fb-75ea5fbb62e0-openshift-service-ca\") pod \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") "
Sep 18 13:36:18.519816 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.519764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8b8w\" (UniqueName: \"kubernetes.io/projected/056a999d-76c5-4984-b1fb-75ea5fbb62e0-kube-api-access-j8b8w\") pod \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") "
Sep 18 13:36:18.519816 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.519802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-metrics-certs\") pod \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\" (UID: \"056a999d-76c5-4984-b1fb-75ea5fbb62e0\") "
Sep 18 13:36:18.520071 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.520036    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056a999d-76c5-4984-b1fb-75ea5fbb62e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "056a999d-76c5-4984-b1fb-75ea5fbb62e0" (UID: "056a999d-76c5-4984-b1fb-75ea5fbb62e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:36:18.520187 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.520171    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/056a999d-76c5-4984-b1fb-75ea5fbb62e0-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:18.522805 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.522728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "056a999d-76c5-4984-b1fb-75ea5fbb62e0" (UID: "056a999d-76c5-4984-b1fb-75ea5fbb62e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:36:18.523131 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.523104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "056a999d-76c5-4984-b1fb-75ea5fbb62e0" (UID: "056a999d-76c5-4984-b1fb-75ea5fbb62e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:36:18.523247 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.523122    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056a999d-76c5-4984-b1fb-75ea5fbb62e0-kube-api-access-j8b8w" (OuterVolumeSpecName: "kube-api-access-j8b8w") pod "056a999d-76c5-4984-b1fb-75ea5fbb62e0" (UID: "056a999d-76c5-4984-b1fb-75ea5fbb62e0"). InnerVolumeSpecName "kube-api-access-j8b8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:18.527482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.527461    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:36:18.621234 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.621124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29096b2e-34e3-468f-a65f-2d6716e99c35-plugins-config-volume\") pod \"29096b2e-34e3-468f-a65f-2d6716e99c35\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") "
Sep 18 13:36:18.621386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.621269    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9ksf\" (UniqueName: \"kubernetes.io/projected/29096b2e-34e3-468f-a65f-2d6716e99c35-kube-api-access-c9ksf\") pod \"29096b2e-34e3-468f-a65f-2d6716e99c35\" (UID: \"29096b2e-34e3-468f-a65f-2d6716e99c35\") "
Sep 18 13:36:18.621491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.621469    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29096b2e-34e3-468f-a65f-2d6716e99c35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29096b2e-34e3-468f-a65f-2d6716e99c35" (UID: "29096b2e-34e3-468f-a65f-2d6716e99c35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:36:18.621539 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.621491    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8b8w\" (UniqueName: \"kubernetes.io/projected/056a999d-76c5-4984-b1fb-75ea5fbb62e0-kube-api-access-j8b8w\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:18.621539 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.621502    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:18.621539 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.621511    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/056a999d-76c5-4984-b1fb-75ea5fbb62e0-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:18.623358 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.623310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29096b2e-34e3-468f-a65f-2d6716e99c35-kube-api-access-c9ksf" (OuterVolumeSpecName: "kube-api-access-c9ksf") pod "29096b2e-34e3-468f-a65f-2d6716e99c35" (UID: "29096b2e-34e3-468f-a65f-2d6716e99c35"). InnerVolumeSpecName "kube-api-access-c9ksf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:18.673664 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.673634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:18.722077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.722044    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9ksf\" (UniqueName: \"kubernetes.io/projected/29096b2e-34e3-468f-a65f-2d6716e99c35-kube-api-access-c9ksf\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:18.722077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.722072    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29096b2e-34e3-468f-a65f-2d6716e99c35-plugins-config-volume\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:18.771180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.771149    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"]
Sep 18 13:36:18.780509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.780479    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-34aeca-59f46499d-88jrz"]
Sep 18 13:36:18.809472 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.809440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:18.905338 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:18.905237    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:19.133180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.133143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:19.215830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.215750    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="056a999d-76c5-4984-b1fb-75ea5fbb62e0" path="/var/lib/kubelet/pods/056a999d-76c5-4984-b1fb-75ea5fbb62e0/volumes"
Sep 18 13:36:19.443948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.443918    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"
Sep 18 13:36:19.443948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.443934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd" event={"ID":"29096b2e-34e3-468f-a65f-2d6716e99c35","Type":"ContainerDied","Data":"15ff35a336fd0165cc81d936607681335466a5389d79cf172872bb1f12b97a65"}
Sep 18 13:36:19.444225 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.443986    2564 scope.go:117] "RemoveContainer" containerID="dd7007c87a58068f7de851ad830221bf62624d0f99b4ad8569a797c0cf191585"
Sep 18 13:36:19.467371 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.467310    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"]
Sep 18 13:36:19.479767 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.479739    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd"]
Sep 18 13:36:19.958388 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:19.958351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:21.182657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:21.182612    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:21.216166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:21.216129    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29096b2e-34e3-468f-a65f-2d6716e99c35" path="/var/lib/kubelet/pods/29096b2e-34e3-468f-a65f-2d6716e99c35/volumes"
Sep 18 13:36:21.423335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:21.423298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:36:22.264142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:22.264093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:23.253449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:23.253413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:24.229132 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:24.229091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:24.632749 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:24.632715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:24.957097 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:24.957008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:25.615884 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:25.615851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:26.785562 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:26.785526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:28.351346 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:28.351307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:29.133757 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:29.133718    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:29.367342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:29.367310    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:29.565626 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:29.565589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:29.723571 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:29.723538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:31.079536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:31.079502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:32.065757 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:32.065720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:33.198462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:33.198427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:35.204602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:35.204562    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:35.400563 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:35.400525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:35.534655 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:35.534615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:36.555813 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:36.555774    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:37.873945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:37.873906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:38.863668 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:38.863633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:40.052263 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:40.052233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:40.557787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:40.557754    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:40.788750 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:40.788710    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"]
Sep 18 13:36:40.788993 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:40.788967    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" podUID="8968a30d-7df4-4cd6-af24-fe325f607aa3" containerName="maas-api" containerID="cri-o://90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950" gracePeriod=30
Sep 18 13:36:40.848465 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:40.848368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:40.986673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:40.986630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:41.056967 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.056939    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:36:41.071105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.071074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:41.161973 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.161876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls\") pod \"8968a30d-7df4-4cd6-af24-fe325f607aa3\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") "
Sep 18 13:36:41.162154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.161971    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6skx\" (UniqueName: \"kubernetes.io/projected/8968a30d-7df4-4cd6-af24-fe325f607aa3-kube-api-access-w6skx\") pod \"8968a30d-7df4-4cd6-af24-fe325f607aa3\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") "
Sep 18 13:36:41.162154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.162038    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8968a30d-7df4-4cd6-af24-fe325f607aa3-openshift-service-ca\") pod \"8968a30d-7df4-4cd6-af24-fe325f607aa3\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") "
Sep 18 13:36:41.162154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.162143    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-metrics-certs\") pod \"8968a30d-7df4-4cd6-af24-fe325f607aa3\" (UID: \"8968a30d-7df4-4cd6-af24-fe325f607aa3\") "
Sep 18 13:36:41.162494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.162442    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8968a30d-7df4-4cd6-af24-fe325f607aa3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8968a30d-7df4-4cd6-af24-fe325f607aa3" (UID: "8968a30d-7df4-4cd6-af24-fe325f607aa3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:36:41.162627 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.162606    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8968a30d-7df4-4cd6-af24-fe325f607aa3-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:41.164138 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.164113    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8968a30d-7df4-4cd6-af24-fe325f607aa3" (UID: "8968a30d-7df4-4cd6-af24-fe325f607aa3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:36:41.164494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.164476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8968a30d-7df4-4cd6-af24-fe325f607aa3" (UID: "8968a30d-7df4-4cd6-af24-fe325f607aa3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:36:41.164684 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.164662    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8968a30d-7df4-4cd6-af24-fe325f607aa3-kube-api-access-w6skx" (OuterVolumeSpecName: "kube-api-access-w6skx") pod "8968a30d-7df4-4cd6-af24-fe325f607aa3" (UID: "8968a30d-7df4-4cd6-af24-fe325f607aa3"). InnerVolumeSpecName "kube-api-access-w6skx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:36:41.176631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.176593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:41.263382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.263341    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:41.263382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.263375    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6skx\" (UniqueName: \"kubernetes.io/projected/8968a30d-7df4-4cd6-af24-fe325f607aa3-kube-api-access-w6skx\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:41.263653 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.263390    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8968a30d-7df4-4cd6-af24-fe325f607aa3-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:36:41.359830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.359792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:41.595147 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.595108    2564 generic.go:356] "Generic (PLEG): container finished" podID="8968a30d-7df4-4cd6-af24-fe325f607aa3" containerID="90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950" exitCode=0
Sep 18 13:36:41.595382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.595173    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"
Sep 18 13:36:41.595382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.595180    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" event={"ID":"8968a30d-7df4-4cd6-af24-fe325f607aa3","Type":"ContainerDied","Data":"90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950"}
Sep 18 13:36:41.595382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.595278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th" event={"ID":"8968a30d-7df4-4cd6-af24-fe325f607aa3","Type":"ContainerDied","Data":"6b5568af254783683fd6fb7e2eda8aad8c6b0d1cc7063c45ee1a4c138d60f8dc"}
Sep 18 13:36:41.595382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.595304    2564 scope.go:117] "RemoveContainer" containerID="90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950"
Sep 18 13:36:41.604620 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.604598    2564 scope.go:117] "RemoveContainer" containerID="90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950"
Sep 18 13:36:41.604929 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:41.604904    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950\": container with ID starting with 90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950 not found: ID does not exist" containerID="90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950"
Sep 18 13:36:41.604996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.604939    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950"} err="failed to get container status \"90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950\": rpc error: code = NotFound desc = could not find container \"90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950\": container with ID starting with 90ca249cd3c139cc1a76e6b79ef06e576ff622daec63fadf8accffaf0b591950 not found: ID does not exist"
Sep 18 13:36:41.625149 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.625115    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"]
Sep 18 13:36:41.628181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.628155    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-021eb8-fcf6d6486-896th"]
Sep 18 13:36:41.657252 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.657216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:41.767415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:41.767380    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:42.658207 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:42.658150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:43.216466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:43.216435    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8968a30d-7df4-4cd6-af24-fe325f607aa3" path="/var/lib/kubelet/pods/8968a30d-7df4-4cd6-af24-fe325f607aa3/volumes"
Sep 18 13:36:43.868621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:43.868589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:44.869895 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:44.869865    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:45.805218 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:45.805169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:46.865993 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:46.865948    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:48.982485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:48.982453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:49.097893 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:49.097858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:49.292614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:49.292576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:49.859752 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:49.859713    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:50.101694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:50.101644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:50.360600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:50.360563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:50.508814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:50.508772    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:50.635027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:50.634934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:53.594979 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:53.594939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:54.255566 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:54.255525    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:54.371608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:54.371565    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:54.823339 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:54.823304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:55.879471 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:55.879434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:56.809657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:56.809617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:57.642240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:57.642207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:58.539038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:58.539002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:59.554680 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.554643    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"]
Sep 18 13:36:59.555176 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555159    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29096b2e-34e3-468f-a65f-2d6716e99c35" containerName="payload-pre-processing"
Sep 18 13:36:59.555176 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555177    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="29096b2e-34e3-468f-a65f-2d6716e99c35" containerName="payload-pre-processing"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555187    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056a999d-76c5-4984-b1fb-75ea5fbb62e0" containerName="maas-api"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555208    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="056a999d-76c5-4984-b1fb-75ea5fbb62e0" containerName="maas-api"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555219    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8968a30d-7df4-4cd6-af24-fe325f607aa3" containerName="maas-api"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555225    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8968a30d-7df4-4cd6-af24-fe325f607aa3" containerName="maas-api"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555295    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="056a999d-76c5-4984-b1fb-75ea5fbb62e0" containerName="maas-api"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555302    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="29096b2e-34e3-468f-a65f-2d6716e99c35" containerName="payload-pre-processing"
Sep 18 13:36:59.555330 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.555310    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8968a30d-7df4-4cd6-af24-fe325f607aa3" containerName="maas-api"
Sep 18 13:36:59.560480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.560456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.563181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.563155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-537abe-serving-cert\""
Sep 18 13:36:59.576112 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.576084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"]
Sep 18 13:36:59.600853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.600818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:59.650666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.650623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4366d31-8522-488d-8ca7-15394254a8db-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.650857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.650722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.650857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.650751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.650857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.650789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hddz\" (UniqueName: \"kubernetes.io/projected/d4366d31-8522-488d-8ca7-15394254a8db-kube-api-access-9hddz\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.717594 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.717549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:36:59.751734 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.751696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4366d31-8522-488d-8ca7-15394254a8db-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.751937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.751875    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.751937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.751924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.752060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.751962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hddz\" (UniqueName: \"kubernetes.io/projected/d4366d31-8522-488d-8ca7-15394254a8db-kube-api-access-9hddz\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.752060 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:59.751998    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-serving-cert: secret "maas-api-e2e-shared-a-w3-537abe-serving-cert" not found
Sep 18 13:36:59.752060 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:36:59.752049    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls podName:d4366d31-8522-488d-8ca7-15394254a8db nodeName:}" failed. No retries permitted until 2026-09-18 13:37:00.252033058 +0000 UTC m=+1337.621292445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls") pod "maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" (UID: "d4366d31-8522-488d-8ca7-15394254a8db") : secret "maas-api-e2e-shared-a-w3-537abe-serving-cert" not found
Sep 18 13:36:59.752414 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.752397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4366d31-8522-488d-8ca7-15394254a8db-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.754524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.754502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.770883 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.770852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hddz\" (UniqueName: \"kubernetes.io/projected/d4366d31-8522-488d-8ca7-15394254a8db-kube-api-access-9hddz\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:36:59.932681 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:36:59.932595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:00.196736 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:00.196644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:00.256584 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:00.256547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:37:00.259052 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:00.259029    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:37:00.299109 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:00.299068    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:00.472897 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:00.472775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:37:00.757086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:00.757054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"]
Sep 18 13:37:00.757515 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:37:00.757298    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4366d31_8522_488d_8ca7_15394254a8db.slice/crio-966beabaf2e13ee167ceb0410cfdcc647bc70a7e56fca21a1003a49816ef86d0 WatchSource:0}: Error finding container 966beabaf2e13ee167ceb0410cfdcc647bc70a7e56fca21a1003a49816ef86d0: Status 404 returned error can't find the container with id 966beabaf2e13ee167ceb0410cfdcc647bc70a7e56fca21a1003a49816ef86d0
Sep 18 13:37:01.722483 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:01.722444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" event={"ID":"d4366d31-8522-488d-8ca7-15394254a8db","Type":"ContainerStarted","Data":"604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a"}
Sep 18 13:37:01.722691 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:01.722498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" event={"ID":"d4366d31-8522-488d-8ca7-15394254a8db","Type":"ContainerStarted","Data":"966beabaf2e13ee167ceb0410cfdcc647bc70a7e56fca21a1003a49816ef86d0"}
Sep 18 13:37:01.722691 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:01.722625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:37:01.747508 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:01.747452    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" podStartSLOduration=2.455900388 podStartE2EDuration="2.747434824s" totalImagesPullingTime="291.534436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:37:01.74418813 +0000 UTC m=+1339.113447537" watchObservedRunningTime="2026-09-18 13:37:01.747434824 +0000 UTC m=+1339.116694206"
Sep 18 13:37:07.735730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:07.735653    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:37:12.661559 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:12.661524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:15.696777 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:15.696727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:18.258398 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:18.258363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:22.116596 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:22.116559    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:23.080531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:23.080496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:24.126717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:24.126678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:24.367177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:24.367137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:24.712822 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:24.712777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:25.136837 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:25.136800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:25.254375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:25.254342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:25.487315 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:25.487278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:26.291751 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:26.291717    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:27.232614 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:27.232575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:28.479581 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:28.479542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:28.623602 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:28.623566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:28.907132 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:28.907087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:30.349518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.349482    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"]
Sep 18 13:37:30.353296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.353277    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.356390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.356367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-c50e10-serving-cert\""
Sep 18 13:37:30.373096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.373063    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"]
Sep 18 13:37:30.396553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.396518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:30.468905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.468868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.469083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.468916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.469083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.469016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zvs\" (UniqueName: \"kubernetes.io/projected/cb51d577-1e3f-4d94-9150-23501898d0e7-kube-api-access-z4zvs\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.469247 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.469089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb51d577-1e3f-4d94-9150-23501898d0e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.526641 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.526597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:30.569750 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.569709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb51d577-1e3f-4d94-9150-23501898d0e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.569930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.569805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.569930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.569851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.569930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.569924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zvs\" (UniqueName: \"kubernetes.io/projected/cb51d577-1e3f-4d94-9150-23501898d0e7-kube-api-access-z4zvs\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.570576 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.570537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb51d577-1e3f-4d94-9150-23501898d0e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.572309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.572281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.572419 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.572386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.582165 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.582137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zvs\" (UniqueName: \"kubernetes.io/projected/cb51d577-1e3f-4d94-9150-23501898d0e7-kube-api-access-z4zvs\") pod \"maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.664679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.664590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:30.944980 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:30.944949    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"]
Sep 18 13:37:30.945675 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:37:30.945652    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb51d577_1e3f_4d94_9150_23501898d0e7.slice/crio-6f953cd1e13f33404aab03d6e185912e02a1e539206677c0066520c4f51ff247 WatchSource:0}: Error finding container 6f953cd1e13f33404aab03d6e185912e02a1e539206677c0066520c4f51ff247: Status 404 returned error can't find the container with id 6f953cd1e13f33404aab03d6e185912e02a1e539206677c0066520c4f51ff247
Sep 18 13:37:31.047948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:31.047912    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:31.311082 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:31.311030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:31.916440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:31.916398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz" event={"ID":"cb51d577-1e3f-4d94-9150-23501898d0e7","Type":"ContainerStarted","Data":"bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510"}
Sep 18 13:37:31.916879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:31.916458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz" event={"ID":"cb51d577-1e3f-4d94-9150-23501898d0e7","Type":"ContainerStarted","Data":"6f953cd1e13f33404aab03d6e185912e02a1e539206677c0066520c4f51ff247"}
Sep 18 13:37:31.916879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:31.916609    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:31.949462 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:31.949381    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz" podStartSLOduration=1.584409306 podStartE2EDuration="1.949363918s" totalImagesPullingTime="364.954612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:37:31.947663186 +0000 UTC m=+1369.316922581" watchObservedRunningTime="2026-09-18 13:37:31.949363918 +0000 UTC m=+1369.318623299"
Sep 18 13:37:32.001516 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:32.001482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:33.292243 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:33.292174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:34.300914 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:34.300876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:35.619629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:35.619584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:36.628360 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:36.628323    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:37.460643 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:37.460608    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:37.929492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:37.929462    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:37:38.469510 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:38.469476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:40.192415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:40.192368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:41.167380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:41.167339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:42.082651 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:42.082611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:43.045523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:43.045483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:43.145661 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:43.145615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:44.340709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:44.340669    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:45.742555 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:45.742514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:47.866000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:47.865957    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:49.470519 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:49.470486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:51.106204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:51.106157    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:37:54.158220 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:37:54.158153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:38:37.023294 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:38:37.023185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:38:50.955114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:38:50.955069    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:04.763672 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:04.763640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:18.470044 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:18.469998    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:19.278023 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:19.277994    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:20.263742 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:20.263709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:21.279473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:21.279438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:21.844595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:21.844557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:22.496289 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:22.496251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:23.432303 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:23.432264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:24.303629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:24.303590    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:25.308250 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:25.308215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:26.124974 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:26.124925    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:27.061456 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:27.061416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:28.269879 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:28.269843    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:30.619856 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:30.619805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:34.065855 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.065820    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"]
Sep 18 13:39:34.066251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.066037    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l" podUID="ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" containerName="maas-api" containerID="cri-o://3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5" gracePeriod=30
Sep 18 13:39:34.114125 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.114083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:34.230807 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.230771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:34.325872 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.325811    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:39:34.404833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.404803    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5hbx\" (UniqueName: \"kubernetes.io/projected/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-kube-api-access-n5hbx\") pod \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") "
Sep 18 13:39:34.405029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.404843    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-maas-api-tls\") pod \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") "
Sep 18 13:39:34.405029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.404883    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-openshift-service-ca\") pod \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") "
Sep 18 13:39:34.405029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.404918    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-metrics-certs\") pod \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\" (UID: \"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90\") "
Sep 18 13:39:34.405374 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.405339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" (UID: "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:39:34.407515 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.407485    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-kube-api-access-n5hbx" (OuterVolumeSpecName: "kube-api-access-n5hbx") pod "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" (UID: "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90"). InnerVolumeSpecName "kube-api-access-n5hbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:39:34.407667 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.407641    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" (UID: "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:39:34.407822 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.407804    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" (UID: "ce86db9b-d30c-4f30-bb5b-cb4df91d6d90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:39:34.408926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.408894    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:34.506940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.506909    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5hbx\" (UniqueName: \"kubernetes.io/projected/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-kube-api-access-n5hbx\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:39:34.506940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.506937    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:39:34.506940 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.506948    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:39:34.507169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.506956    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:39:34.618504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.618404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:34.692918 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.692881    2564 generic.go:356] "Generic (PLEG): container finished" podID="ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" containerID="3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5" exitCode=0
Sep 18 13:39:34.693105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.692934    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"
Sep 18 13:39:34.693105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.692963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l" event={"ID":"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90","Type":"ContainerDied","Data":"3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5"}
Sep 18 13:39:34.693105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.693013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l" event={"ID":"ce86db9b-d30c-4f30-bb5b-cb4df91d6d90","Type":"ContainerDied","Data":"2df34ed6f5453d11e2d66aee2d58c4bc289c9b6c40bfd47294ea4e0afbafa0ab"}
Sep 18 13:39:34.693105 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.693038    2564 scope.go:117] "RemoveContainer" containerID="3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5"
Sep 18 13:39:34.703839 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.703824    2564 scope.go:117] "RemoveContainer" containerID="3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5"
Sep 18 13:39:34.704127 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:39:34.704109    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5\": container with ID starting with 3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5 not found: ID does not exist" containerID="3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5"
Sep 18 13:39:34.704185 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.704134    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5"} err="failed to get container status \"3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5\": rpc error: code = NotFound desc = could not find container \"3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5\": container with ID starting with 3e0bdabd63bd840a619cdbeb514edda90444fe16c0d87daefe5a35bf249d7da5 not found: ID does not exist"
Sep 18 13:39:34.730460 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.730426    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"]
Sep 18 13:39:34.733495 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:34.733473    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fa9905fd-7cdf6b97d5-z686l"]
Sep 18 13:39:35.219217 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:35.218733    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" path="/var/lib/kubelet/pods/ce86db9b-d30c-4f30-bb5b-cb4df91d6d90/volumes"
Sep 18 13:39:35.304418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:35.304379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:36.098389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:36.098353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:36.946719 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:36.946685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:37.905322 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:37.905290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:38.067647 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:38.067614    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:38.229651 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:38.229576    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:39.041221 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:39.041167    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:40.171635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:40.171589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:41.157833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:41.157804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:43.201307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:43.201264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:39:43.241568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:43.241537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:39:43.242068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:43.242050    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:39:46.117111 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:39:46.117070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:20.603331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:20.603295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:20.681124 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:20.681091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:21.252076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:21.252039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:30.171949 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:30.171882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:34.136831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:34.136787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:38.766128 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:38.766089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:45.270846 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:45.270814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:45.467759 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:45.467716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:45.585840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:45.585736    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:46.985663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:46.985627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:47.136679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:47.136650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:47.268987 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:47.268898    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:47.956255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:47.956183    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:48.052211 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:48.052161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:48.148898 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:48.148852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:49.236040 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:49.236001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:49.527529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:49.527440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:50.775332 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:50.775294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:56.391133 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:56.391097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:56.494051 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:56.494019    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:40:57.082251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:40:57.082215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:03.462251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:03.462176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:03.592801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:03.592766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:03.748265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:03.748233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:06.961882 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:06.961844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:14.236583 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:14.236544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:14.446389 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:14.446364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:15.123916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:15.123885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:35.476186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:35.476147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:41.760680 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:41.760642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:41.876243 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:41.876217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:42.185408 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:42.185351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:42.631671 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:42.631641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:42.768796 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:42.768752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:45.307108 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:45.307072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:45.728251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:45.728148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:45.823270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:45.823230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:46.784778 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:46.784726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:47.983521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:47.983485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:48.621733 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:48.621683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:49.568764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:49.568727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:50.367791 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:50.367754    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:51.191058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:51.191027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:52.009453 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.009418    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"]
Sep 18 13:41:52.010168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.010152    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" containerName="maas-api"
Sep 18 13:41:52.010237 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.010172    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" containerName="maas-api"
Sep 18 13:41:52.010326 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.010314    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce86db9b-d30c-4f30-bb5b-cb4df91d6d90" containerName="maas-api"
Sep 18 13:41:52.014079 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.014058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.017266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.017244    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-bc95f3-serving-cert\""
Sep 18 13:41:52.029419 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.029396    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"]
Sep 18 13:41:52.034276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.034248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsxq9\" (UniqueName: \"kubernetes.io/projected/e4381556-6258-4ecb-ab85-4f4d3d6800e4-kube-api-access-bsxq9\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.034395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.034374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4381556-6258-4ecb-ab85-4f4d3d6800e4-openshift-service-ca\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.034461 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.034424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.034509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.034469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-metrics-certs\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.061504 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.061474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:52.135539 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.135515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsxq9\" (UniqueName: \"kubernetes.io/projected/e4381556-6258-4ecb-ab85-4f4d3d6800e4-kube-api-access-bsxq9\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.135660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.135576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4381556-6258-4ecb-ab85-4f4d3d6800e4-openshift-service-ca\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.135660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.135601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.135660 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.135627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-metrics-certs\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.135825 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:41:52.135720    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-serving-cert: secret "maas-api-e2e-api-a-bc95f3-serving-cert" not found
Sep 18 13:41:52.135825 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:41:52.135771    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls podName:e4381556-6258-4ecb-ab85-4f4d3d6800e4 nodeName:}" failed. No retries permitted until 2026-09-18 13:41:52.635751327 +0000 UTC m=+1630.005010702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls") pod "maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" (UID: "e4381556-6258-4ecb-ab85-4f4d3d6800e4") : secret "maas-api-e2e-api-a-bc95f3-serving-cert" not found
Sep 18 13:41:52.136295 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.136273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4381556-6258-4ecb-ab85-4f4d3d6800e4-openshift-service-ca\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.137966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.137946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-metrics-certs\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.146636 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.146613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsxq9\" (UniqueName: \"kubernetes.io/projected/e4381556-6258-4ecb-ab85-4f4d3d6800e4-kube-api-access-bsxq9\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.150868 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.150843    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:52.400546 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.400482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:52.603381 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.603342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:52.639787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.639762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.642177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.642150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls\") pod \"maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:52.696278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.696216    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:41:52.925116 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:52.925087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:53.204608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:53.204577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"]
Sep 18 13:41:53.205344 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:41:53.205321    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4381556_6258_4ecb_ab85_4f4d3d6800e4.slice/crio-2d41170e0717c59851107fcf14003d7fc0fe8e44dc929c8d83a9b0ae51fc78c9 WatchSource:0}: Error finding container 2d41170e0717c59851107fcf14003d7fc0fe8e44dc929c8d83a9b0ae51fc78c9: Status 404 returned error can't find the container with id 2d41170e0717c59851107fcf14003d7fc0fe8e44dc929c8d83a9b0ae51fc78c9
Sep 18 13:41:53.206764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:53.206745    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:41:53.523184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:53.523152    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" event={"ID":"e4381556-6258-4ecb-ab85-4f4d3d6800e4","Type":"ContainerStarted","Data":"2d41170e0717c59851107fcf14003d7fc0fe8e44dc929c8d83a9b0ae51fc78c9"}
Sep 18 13:41:54.532085 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:54.532050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" event={"ID":"e4381556-6258-4ecb-ab85-4f4d3d6800e4","Type":"ContainerStarted","Data":"b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853"}
Sep 18 13:41:54.532501 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:54.532110    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:41:54.555116 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:54.555068    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" podStartSLOduration=2.964218103 podStartE2EDuration="3.555054353s" totalImagesPullingTime="590.83625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:41:54.55414614 +0000 UTC m=+1631.923405523" watchObservedRunningTime="2026-09-18 13:41:54.555054353 +0000 UTC m=+1631.924313736"
Sep 18 13:41:54.846964 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:41:54.846887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:00.547293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:00.547265    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:42:14.252821 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:14.252788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:15.053417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:15.053377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:15.753756 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:15.753720    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:15.866060 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:15.866027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:16.394300 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:16.394260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:16.609446 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:16.609396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:16.775415 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:16.775383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:17.079598 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:17.079517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:17.520666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:17.520634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:18.529144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:18.529111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:19.332428 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:19.332388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:19.804377 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:19.804333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:19.892942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:19.892911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:20.396971 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:20.396939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:21.217674 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.217644    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"]
Sep 18 13:42:21.221792 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.221765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.224494 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.224470    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-57732b-serving-cert\""
Sep 18 13:42:21.230299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.230271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"]
Sep 18 13:42:21.265840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.265809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:21.318317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.318284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-metrics-certs\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.318480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.318358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dca6fc-5da8-4dd4-868d-c3318785ab21-openshift-service-ca\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.318583 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.318558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nz4l\" (UniqueName: \"kubernetes.io/projected/71dca6fc-5da8-4dd4-868d-c3318785ab21-kube-api-access-4nz4l\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.318677 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.318655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.360166 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.360130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:21.419741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.419696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-metrics-certs\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.419930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.419792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dca6fc-5da8-4dd4-868d-c3318785ab21-openshift-service-ca\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.419930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.419827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nz4l\" (UniqueName: \"kubernetes.io/projected/71dca6fc-5da8-4dd4-868d-c3318785ab21-kube-api-access-4nz4l\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.419930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.419867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.420090 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:42:21.420062    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-serving-cert: secret "maas-api-e2e-api-b-57732b-serving-cert" not found
Sep 18 13:42:21.420180 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:42:21.420160    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls podName:71dca6fc-5da8-4dd4-868d-c3318785ab21 nodeName:}" failed. No retries permitted until 2026-09-18 13:42:21.920137365 +0000 UTC m=+1659.289396738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls") pod "maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" (UID: "71dca6fc-5da8-4dd4-868d-c3318785ab21") : secret "maas-api-e2e-api-b-57732b-serving-cert" not found
Sep 18 13:42:21.420489 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.420471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dca6fc-5da8-4dd4-868d-c3318785ab21-openshift-service-ca\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.422144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.422120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-metrics-certs\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.429753 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.429731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nz4l\" (UniqueName: \"kubernetes.io/projected/71dca6fc-5da8-4dd4-868d-c3318785ab21-kube-api-access-4nz4l\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.510843 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.510805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:21.925495 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.925396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.927850 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.927827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls\") pod \"maas-api-e2e-api-b-57732b-84d6d78645-9jtmn\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:21.999410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:21.999369    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:22.097971 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:22.097920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:22.135281 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:22.135230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:22.423053 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:22.423024    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"]
Sep 18 13:42:22.424324 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:42:22.424298    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dca6fc_5da8_4dd4_868d_c3318785ab21.slice/crio-1d4bf98e11055a358f1fba7c968ad06c9f44c197680f41bab0232b11f49b2985 WatchSource:0}: Error finding container 1d4bf98e11055a358f1fba7c968ad06c9f44c197680f41bab0232b11f49b2985: Status 404 returned error can't find the container with id 1d4bf98e11055a358f1fba7c968ad06c9f44c197680f41bab0232b11f49b2985
Sep 18 13:42:22.718384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:22.718357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" event={"ID":"71dca6fc-5da8-4dd4-868d-c3318785ab21","Type":"ContainerStarted","Data":"1d4bf98e11055a358f1fba7c968ad06c9f44c197680f41bab0232b11f49b2985"}
Sep 18 13:42:22.719704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:22.719678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:23.712707 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:23.712670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:23.727228 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:23.727183    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" event={"ID":"71dca6fc-5da8-4dd4-868d-c3318785ab21","Type":"ContainerStarted","Data":"dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a"}
Sep 18 13:42:23.727400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:23.727383    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:23.758884 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:23.758841    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" podStartSLOduration=2.424799869 podStartE2EDuration="2.758827846s" totalImagesPullingTime="334.027977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:42:23.75631981 +0000 UTC m=+1661.125579193" watchObservedRunningTime="2026-09-18 13:42:23.758827846 +0000 UTC m=+1661.128087228"
Sep 18 13:42:24.708067 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:24.708027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:25.647421 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:25.647378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:26.496427 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:26.496379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:27.559684 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:27.559641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:28.458354 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:28.458315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:29.739916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:29.739885    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:42:43.679240 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:43.679168    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:44.429514 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:44.429477    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:44.700312 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:44.700222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:45.319608 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:45.319575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:46.249223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:46.249179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:47.187132 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:47.187093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:48.192741 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:48.192708    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:48.964410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:48.964378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:50.279930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:50.279897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:51.137241 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:51.137201    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:52.107323 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:52.107285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:53.124077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:53.124039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:54.158595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:54.158557    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:54.956487 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:54.956457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:55.718211 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:55.718164    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:56.572896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:56.572862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:42:58.216107 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:42:58.216073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:10.462871 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.462795    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"]
Sep 18 13:43:10.463265 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.463004    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" podUID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" containerName="maas-api" containerID="cri-o://b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853" gracePeriod=30
Sep 18 13:43:10.489159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.489126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:10.542866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.542815    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" podUID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.88:8443/health\": dial tcp 10.132.0.88:8443: connect: connection refused"
Sep 18 13:43:10.718268 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.718215    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:43:10.798035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.798014    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4381556-6258-4ecb-ab85-4f4d3d6800e4-openshift-service-ca\") pod \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") "
Sep 18 13:43:10.798223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.798065    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-metrics-certs\") pod \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") "
Sep 18 13:43:10.798223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.798149    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls\") pod \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") "
Sep 18 13:43:10.798223 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.798180    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsxq9\" (UniqueName: \"kubernetes.io/projected/e4381556-6258-4ecb-ab85-4f4d3d6800e4-kube-api-access-bsxq9\") pod \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\" (UID: \"e4381556-6258-4ecb-ab85-4f4d3d6800e4\") "
Sep 18 13:43:10.798472 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.798435    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4381556-6258-4ecb-ab85-4f4d3d6800e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4381556-6258-4ecb-ab85-4f4d3d6800e4" (UID: "e4381556-6258-4ecb-ab85-4f4d3d6800e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:43:10.798591 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.798540    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4381556-6258-4ecb-ab85-4f4d3d6800e4-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:10.800171 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.800143    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e4381556-6258-4ecb-ab85-4f4d3d6800e4" (UID: "e4381556-6258-4ecb-ab85-4f4d3d6800e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:43:10.800327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.800302    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4381556-6258-4ecb-ab85-4f4d3d6800e4" (UID: "e4381556-6258-4ecb-ab85-4f4d3d6800e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:43:10.800373 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.800327    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4381556-6258-4ecb-ab85-4f4d3d6800e4-kube-api-access-bsxq9" (OuterVolumeSpecName: "kube-api-access-bsxq9") pod "e4381556-6258-4ecb-ab85-4f4d3d6800e4" (UID: "e4381556-6258-4ecb-ab85-4f4d3d6800e4"). InnerVolumeSpecName "kube-api-access-bsxq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:43:10.899360 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.899327    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:10.899360 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.899356    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4381556-6258-4ecb-ab85-4f4d3d6800e4-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:10.899360 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:10.899368    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsxq9\" (UniqueName: \"kubernetes.io/projected/e4381556-6258-4ecb-ab85-4f4d3d6800e4-kube-api-access-bsxq9\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:11.033609 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.033574    2564 generic.go:356] "Generic (PLEG): container finished" podID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" containerID="b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853" exitCode=0
Sep 18 13:43:11.033776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.033616    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"
Sep 18 13:43:11.033776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.033615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" event={"ID":"e4381556-6258-4ecb-ab85-4f4d3d6800e4","Type":"ContainerDied","Data":"b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853"}
Sep 18 13:43:11.033776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.033744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk" event={"ID":"e4381556-6258-4ecb-ab85-4f4d3d6800e4","Type":"ContainerDied","Data":"2d41170e0717c59851107fcf14003d7fc0fe8e44dc929c8d83a9b0ae51fc78c9"}
Sep 18 13:43:11.033776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.033775    2564 scope.go:117] "RemoveContainer" containerID="b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853"
Sep 18 13:43:11.043694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.043679    2564 scope.go:117] "RemoveContainer" containerID="b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853"
Sep 18 13:43:11.043953 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:43:11.043935    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853\": container with ID starting with b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853 not found: ID does not exist" containerID="b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853"
Sep 18 13:43:11.043992 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:11.043961    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853"} err="failed to get container status \"b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853\": rpc error: code = NotFound desc = could not find container \"b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853\": container with ID starting with b8540e6bba7a34c713652667831358c258e1a0c9f36a8d93e4889de4702bd853 not found: ID does not exist"
Sep 18 13:43:13.845965 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:13.845910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:13.848937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:13.848912    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"]
Sep 18 13:43:13.860719 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:13.860689    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bc95f3-6d77d64884-q2ckk"]
Sep 18 13:43:13.953452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:13.953395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:14.056501 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:14.056469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:14.162437 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:14.162337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:14.296454 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:14.296418    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:14.628449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:14.628394    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:14.750628 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:14.750587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:15.215241 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:15.215212    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" path="/var/lib/kubelet/pods/e4381556-6258-4ecb-ab85-4f4d3d6800e4/volumes"
Sep 18 13:43:16.649703 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:16.649673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:18.438121 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:18.438078    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:20.238148 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:20.238118    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:22.251378 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:22.251349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:24.087332 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:24.087290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:25.875561 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:25.875520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:28.011916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:28.011872    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:29.083051 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:29.083023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:29.381609 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:29.381515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:29.575923 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:29.575885    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:30.320714 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:30.320674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:32.312170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:32.312130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:34.326825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:34.326792    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:35.883342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:35.883303    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:37.065667 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:37.065631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:38.597253 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:38.597215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:40.069945 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:40.069900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:41.229615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:41.229577    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:47.197638 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.197603    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"]
Sep 18 13:43:47.198015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.197815    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" podUID="71dca6fc-5da8-4dd4-868d-c3318785ab21" containerName="maas-api" containerID="cri-o://dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a" gracePeriod=30
Sep 18 13:43:47.299307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.299261    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:47.463905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.463852    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:43:47.568184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.568156    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-metrics-certs\") pod \"71dca6fc-5da8-4dd4-868d-c3318785ab21\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") "
Sep 18 13:43:47.568356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.568338    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls\") pod \"71dca6fc-5da8-4dd4-868d-c3318785ab21\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") "
Sep 18 13:43:47.568399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.568384    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dca6fc-5da8-4dd4-868d-c3318785ab21-openshift-service-ca\") pod \"71dca6fc-5da8-4dd4-868d-c3318785ab21\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") "
Sep 18 13:43:47.568460 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.568444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nz4l\" (UniqueName: \"kubernetes.io/projected/71dca6fc-5da8-4dd4-868d-c3318785ab21-kube-api-access-4nz4l\") pod \"71dca6fc-5da8-4dd4-868d-c3318785ab21\" (UID: \"71dca6fc-5da8-4dd4-868d-c3318785ab21\") "
Sep 18 13:43:47.568768 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.568735    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71dca6fc-5da8-4dd4-868d-c3318785ab21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71dca6fc-5da8-4dd4-868d-c3318785ab21" (UID: "71dca6fc-5da8-4dd4-868d-c3318785ab21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:43:47.570293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.570267    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "71dca6fc-5da8-4dd4-868d-c3318785ab21" (UID: "71dca6fc-5da8-4dd4-868d-c3318785ab21"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:43:47.570416 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.570401    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71dca6fc-5da8-4dd4-868d-c3318785ab21" (UID: "71dca6fc-5da8-4dd4-868d-c3318785ab21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:43:47.570510 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.570495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71dca6fc-5da8-4dd4-868d-c3318785ab21-kube-api-access-4nz4l" (OuterVolumeSpecName: "kube-api-access-4nz4l") pod "71dca6fc-5da8-4dd4-868d-c3318785ab21" (UID: "71dca6fc-5da8-4dd4-868d-c3318785ab21"). InnerVolumeSpecName "kube-api-access-4nz4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:43:47.594629 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.594598    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:47.669996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.669947    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:47.669996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.669974    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71dca6fc-5da8-4dd4-868d-c3318785ab21-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:47.669996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.669988    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nz4l\" (UniqueName: \"kubernetes.io/projected/71dca6fc-5da8-4dd4-868d-c3318785ab21-kube-api-access-4nz4l\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:47.669996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.670001    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dca6fc-5da8-4dd4-868d-c3318785ab21-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:43:47.913117 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:47.913087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:48.265937 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.265904    2564 generic.go:356] "Generic (PLEG): container finished" podID="71dca6fc-5da8-4dd4-868d-c3318785ab21" containerID="dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a" exitCode=0
Sep 18 13:43:48.266337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.265951    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"
Sep 18 13:43:48.266337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.265991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" event={"ID":"71dca6fc-5da8-4dd4-868d-c3318785ab21","Type":"ContainerDied","Data":"dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a"}
Sep 18 13:43:48.266337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.266046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn" event={"ID":"71dca6fc-5da8-4dd4-868d-c3318785ab21","Type":"ContainerDied","Data":"1d4bf98e11055a358f1fba7c968ad06c9f44c197680f41bab0232b11f49b2985"}
Sep 18 13:43:48.266337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.266067    2564 scope.go:117] "RemoveContainer" containerID="dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a"
Sep 18 13:43:48.279966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.279945    2564 scope.go:117] "RemoveContainer" containerID="dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a"
Sep 18 13:43:48.280362 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:43:48.280337    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a\": container with ID starting with dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a not found: ID does not exist" containerID="dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a"
Sep 18 13:43:48.280431 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.280367    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a"} err="failed to get container status \"dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a\": rpc error: code = NotFound desc = could not find container \"dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a\": container with ID starting with dd58ef03b55bbcf83c24928822369f41a6d2fe9d5b42d0dd27db4bf3f8d3965a not found: ID does not exist"
Sep 18 13:43:48.309219 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.309182    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"]
Sep 18 13:43:48.329762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.329729    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:48.334128 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.334107    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57732b-84d6d78645-9jtmn"]
Sep 18 13:43:48.658930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:48.658838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:49.019582 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:49.019549    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:49.214964 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:49.214936    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71dca6fc-5da8-4dd4-868d-c3318785ab21" path="/var/lib/kubelet/pods/71dca6fc-5da8-4dd4-868d-c3318785ab21/volumes"
Sep 18 13:43:50.408811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:50.408753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:51.825161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:51.825120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:53.214960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:53.214930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:53.844251 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:53.844213    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"]
Sep 18 13:43:54.084180 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:54.084142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:55.130658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:55.130620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:56.506611 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:56.506575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:58.054690 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:58.054657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:59.470456 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:59.470423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:59.675068 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:59.675028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:43:59.932336 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:43:59.932299    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:00.375851 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:00.375815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:02.111530 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:02.111491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:03.563404 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:03.563368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:05.407047 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:05.407013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:06.522414 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:06.522375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:07.462236 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:07.462174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:08.863541 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:08.863480    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz" podUID="7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" containerName="main" containerID="cri-o://fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6" gracePeriod=45
Sep 18 13:44:08.965084 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:08.965042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:09.116919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.116867    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:44:09.187603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.187571    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tls-certs\") pod \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") "
Sep 18 13:44:09.187787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.187636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tmp-dir\") pod \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") "
Sep 18 13:44:09.187787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.187697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-model-cache\") pod \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") "
Sep 18 13:44:09.187910 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.187820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-home\") pod \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") "
Sep 18 13:44:09.187910 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.187862    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7w9q\" (UniqueName: \"kubernetes.io/projected/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-kube-api-access-m7w9q\") pod \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") "
Sep 18 13:44:09.187910 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.187901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-dshm\") pod \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\" (UID: \"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d\") "
Sep 18 13:44:09.188096 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.188068    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" (UID: "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:44:09.188361 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.188317    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" (UID: "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:44:09.188361 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.188349    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-home" (OuterVolumeSpecName: "home") pod "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" (UID: "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:44:09.188543 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.188374    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-model-cache\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:09.190998 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.190969    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-kube-api-access-m7w9q" (OuterVolumeSpecName: "kube-api-access-m7w9q") pod "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" (UID: "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d"). InnerVolumeSpecName "kube-api-access-m7w9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:44:09.191106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.191011    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" (UID: "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:09.191174 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.191134    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-dshm" (OuterVolumeSpecName: "dshm") pod "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" (UID: "7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:44:09.289795 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.289764    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tmp-dir\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:09.289795 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.289792    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-home\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:09.290001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.289806    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7w9q\" (UniqueName: \"kubernetes.io/projected/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-kube-api-access-m7w9q\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:09.290001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.289819    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-dshm\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:09.290001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.289827    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d-tls-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:09.399742 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.399646    2564 generic.go:356] "Generic (PLEG): container finished" podID="7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" containerID="fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6" exitCode=0
Sep 18 13:44:09.399905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.399750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"
Sep 18 13:44:09.399905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.399760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz" event={"ID":"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d","Type":"ContainerDied","Data":"fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6"}
Sep 18 13:44:09.399905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.399804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz" event={"ID":"7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d","Type":"ContainerDied","Data":"8135bc072d73a0ddaf6602a5565d1017e7716f3c814df99026ddbcdf97055a6f"}
Sep 18 13:44:09.399905 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.399826    2564 scope.go:117] "RemoveContainer" containerID="fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6"
Sep 18 13:44:09.409692 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.409670    2564 scope.go:117] "RemoveContainer" containerID="fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6"
Sep 18 13:44:09.409951 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:44:09.409931    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6\": container with ID starting with fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6 not found: ID does not exist" containerID="fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6"
Sep 18 13:44:09.410028 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.409961    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6"} err="failed to get container status \"fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6\": rpc error: code = NotFound desc = could not find container \"fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6\": container with ID starting with fb1d18e2f151305b4f1bd2505d155dbbf82e8ebb79fc5c7fe5f935f7b33eade6 not found: ID does not exist"
Sep 18 13:44:09.434922 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.434897    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"]
Sep 18 13:44:09.440008 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.439989    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-951469/simulator-w0-951469-kserve-5bbf9dd96c-rmxqz"]
Sep 18 13:44:09.999553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.999519    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"]
Sep 18 13:44:09.999954 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:09.999728    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7" podUID="adb7123c-54ca-46d8-9010-69323e6a5fad" containerName="maas-api" containerID="cri-o://43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3" gracePeriod=30
Sep 18 13:44:10.070087 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.070030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:10.208640 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.208591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:10.266875 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.266824    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:44:10.340307 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.340278    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"]
Sep 18 13:44:10.340547 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.340521    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" podUID="419ebfc5-6dea-4e40-9b12-28b433d11ff8" containerName="maas-api" containerID="cri-o://825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac" gracePeriod=30
Sep 18 13:44:10.391854 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.391824    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:10.402557 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.402531    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw5gr\" (UniqueName: \"kubernetes.io/projected/adb7123c-54ca-46d8-9010-69323e6a5fad-kube-api-access-bw5gr\") pod \"adb7123c-54ca-46d8-9010-69323e6a5fad\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") "
Sep 18 13:44:10.402678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.402658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-metrics-certs\") pod \"adb7123c-54ca-46d8-9010-69323e6a5fad\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") "
Sep 18 13:44:10.402759 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.402739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb7123c-54ca-46d8-9010-69323e6a5fad-openshift-service-ca\") pod \"adb7123c-54ca-46d8-9010-69323e6a5fad\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") "
Sep 18 13:44:10.402880 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.402802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-maas-api-tls\") pod \"adb7123c-54ca-46d8-9010-69323e6a5fad\" (UID: \"adb7123c-54ca-46d8-9010-69323e6a5fad\") "
Sep 18 13:44:10.403110 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.403078    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb7123c-54ca-46d8-9010-69323e6a5fad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adb7123c-54ca-46d8-9010-69323e6a5fad" (UID: "adb7123c-54ca-46d8-9010-69323e6a5fad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:44:10.403206 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.403160    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb7123c-54ca-46d8-9010-69323e6a5fad-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.404925 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.404892    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb7123c-54ca-46d8-9010-69323e6a5fad-kube-api-access-bw5gr" (OuterVolumeSpecName: "kube-api-access-bw5gr") pod "adb7123c-54ca-46d8-9010-69323e6a5fad" (UID: "adb7123c-54ca-46d8-9010-69323e6a5fad"). InnerVolumeSpecName "kube-api-access-bw5gr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:44:10.405293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.405266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "adb7123c-54ca-46d8-9010-69323e6a5fad" (UID: "adb7123c-54ca-46d8-9010-69323e6a5fad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:10.405392 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.405329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adb7123c-54ca-46d8-9010-69323e6a5fad" (UID: "adb7123c-54ca-46d8-9010-69323e6a5fad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:10.410182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.410157    2564 generic.go:356] "Generic (PLEG): container finished" podID="adb7123c-54ca-46d8-9010-69323e6a5fad" containerID="43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3" exitCode=0
Sep 18 13:44:10.410311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.410229    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"
Sep 18 13:44:10.410311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.410234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7" event={"ID":"adb7123c-54ca-46d8-9010-69323e6a5fad","Type":"ContainerDied","Data":"43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3"}
Sep 18 13:44:10.410311 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.410292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7" event={"ID":"adb7123c-54ca-46d8-9010-69323e6a5fad","Type":"ContainerDied","Data":"1f919e21a9f1216909d66291527f403164491ddda00c6e443e3381e6d9fcee56"}
Sep 18 13:44:10.410480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.410320    2564 scope.go:117] "RemoveContainer" containerID="43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3"
Sep 18 13:44:10.453987 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.453871    2564 scope.go:117] "RemoveContainer" containerID="43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3"
Sep 18 13:44:10.454321 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:44:10.454287    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3\": container with ID starting with 43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3 not found: ID does not exist" containerID="43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3"
Sep 18 13:44:10.454429 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.454324    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3"} err="failed to get container status \"43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3\": rpc error: code = NotFound desc = could not find container \"43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3\": container with ID starting with 43a0bcb975b8c1083aa22f29e70cc3b16456b484d3690e6f7c01d41906367df3 not found: ID does not exist"
Sep 18 13:44:10.456278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.456254    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"]
Sep 18 13:44:10.463751 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.463727    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-951469-84f9ff7488-4sbc7"]
Sep 18 13:44:10.504666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.504630    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.504666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.504656    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adb7123c-54ca-46d8-9010-69323e6a5fad-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.504666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.504669    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw5gr\" (UniqueName: \"kubernetes.io/projected/adb7123c-54ca-46d8-9010-69323e6a5fad-kube-api-access-bw5gr\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.541853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.541803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:10.605458 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.605436    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:44:10.705850 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.705805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:10.706029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.705963    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419ebfc5-6dea-4e40-9b12-28b433d11ff8-openshift-service-ca\") pod \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") "
Sep 18 13:44:10.706029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.706016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls\") pod \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") "
Sep 18 13:44:10.706183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.706165    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-metrics-certs\") pod \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") "
Sep 18 13:44:10.706267 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.706220    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j54s\" (UniqueName: \"kubernetes.io/projected/419ebfc5-6dea-4e40-9b12-28b433d11ff8-kube-api-access-5j54s\") pod \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\" (UID: \"419ebfc5-6dea-4e40-9b12-28b433d11ff8\") "
Sep 18 13:44:10.706373 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.706348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419ebfc5-6dea-4e40-9b12-28b433d11ff8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "419ebfc5-6dea-4e40-9b12-28b433d11ff8" (UID: "419ebfc5-6dea-4e40-9b12-28b433d11ff8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:44:10.706572 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.706554    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/419ebfc5-6dea-4e40-9b12-28b433d11ff8-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.708153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.708134    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "419ebfc5-6dea-4e40-9b12-28b433d11ff8" (UID: "419ebfc5-6dea-4e40-9b12-28b433d11ff8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:10.708239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.708172    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419ebfc5-6dea-4e40-9b12-28b433d11ff8-kube-api-access-5j54s" (OuterVolumeSpecName: "kube-api-access-5j54s") pod "419ebfc5-6dea-4e40-9b12-28b433d11ff8" (UID: "419ebfc5-6dea-4e40-9b12-28b433d11ff8"). InnerVolumeSpecName "kube-api-access-5j54s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:44:10.708239 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.708220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "419ebfc5-6dea-4e40-9b12-28b433d11ff8" (UID: "419ebfc5-6dea-4e40-9b12-28b433d11ff8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:10.807949 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.807876    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.807949 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.807903    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/419ebfc5-6dea-4e40-9b12-28b433d11ff8-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.807949 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.807912    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j54s\" (UniqueName: \"kubernetes.io/projected/419ebfc5-6dea-4e40-9b12-28b433d11ff8-kube-api-access-5j54s\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:10.961382 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:10.957871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:11.065066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.064969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:11.216098 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.216059    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" path="/var/lib/kubelet/pods/7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d/volumes"
Sep 18 13:44:11.216492 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.216478    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adb7123c-54ca-46d8-9010-69323e6a5fad" path="/var/lib/kubelet/pods/adb7123c-54ca-46d8-9010-69323e6a5fad/volumes"
Sep 18 13:44:11.419118 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.419038    2564 generic.go:356] "Generic (PLEG): container finished" podID="419ebfc5-6dea-4e40-9b12-28b433d11ff8" containerID="825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac" exitCode=0
Sep 18 13:44:11.419118 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.419096    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"
Sep 18 13:44:11.419370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.419118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" event={"ID":"419ebfc5-6dea-4e40-9b12-28b433d11ff8","Type":"ContainerDied","Data":"825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac"}
Sep 18 13:44:11.419370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.419165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth" event={"ID":"419ebfc5-6dea-4e40-9b12-28b433d11ff8","Type":"ContainerDied","Data":"04de00f231b6866d218158b3aaa81fdf86522b9ae16a61bce24a6545a12b0179"}
Sep 18 13:44:11.419370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.419228    2564 scope.go:117] "RemoveContainer" containerID="825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac"
Sep 18 13:44:11.429740 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.426923    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:11.431843 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.431821    2564 scope.go:117] "RemoveContainer" containerID="825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac"
Sep 18 13:44:11.432157 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:44:11.432137    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac\": container with ID starting with 825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac not found: ID does not exist" containerID="825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac"
Sep 18 13:44:11.432259 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.432169    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac"} err="failed to get container status \"825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac\": rpc error: code = NotFound desc = could not find container \"825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac\": container with ID starting with 825cffd0351a104a1cc232d575feb569030ffaad31102818382ffdfe2f1e2fac not found: ID does not exist"
Sep 18 13:44:11.451900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.451877    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"]
Sep 18 13:44:11.454625 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.454605    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-b2d5da-c9665f695-64wth"]
Sep 18 13:44:11.957809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:11.957775    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:13.054466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:13.054431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:13.215758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:13.215725    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="419ebfc5-6dea-4e40-9b12-28b433d11ff8" path="/var/lib/kubelet/pods/419ebfc5-6dea-4e40-9b12-28b433d11ff8/volumes"
Sep 18 13:44:14.033084 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:14.033051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:15.063715 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:15.063667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:16.283488 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:16.283456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:19.168706 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:19.168655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:19.447823 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:19.447730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:19.556637 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:19.556606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:19.955037 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:19.955005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:20.054456 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:20.054428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:20.217538 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:20.217453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:20.690707 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:20.690671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:21.855874 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:21.855832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:23.170156 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:23.170121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:24.081858 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:24.081817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:25.051651 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:25.051616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:26.245155 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:26.245120    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:30.820488 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:30.820453    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:31.398294 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:31.398260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:31.640222 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:31.640155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:32.220077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:32.220044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:33.953297 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:33.953261    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"]
Sep 18 13:44:33.953670 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:33.953496    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" podUID="38c6890b-942a-4e42-95ba-129771debc17" containerName="maas-api" containerID="cri-o://e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116" gracePeriod=30
Sep 18 13:44:33.978286 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:33.978256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:34.218581 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.218528    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:44:34.257131 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.257085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:34.332173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.332138    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38c6890b-942a-4e42-95ba-129771debc17-openshift-service-ca\") pod \"38c6890b-942a-4e42-95ba-129771debc17\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") "
Sep 18 13:44:34.332173 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.332177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d6hx\" (UniqueName: \"kubernetes.io/projected/38c6890b-942a-4e42-95ba-129771debc17-kube-api-access-5d6hx\") pod \"38c6890b-942a-4e42-95ba-129771debc17\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") "
Sep 18 13:44:34.332441 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.332288    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls\") pod \"38c6890b-942a-4e42-95ba-129771debc17\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") "
Sep 18 13:44:34.332441 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.332346    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-metrics-certs\") pod \"38c6890b-942a-4e42-95ba-129771debc17\" (UID: \"38c6890b-942a-4e42-95ba-129771debc17\") "
Sep 18 13:44:34.332580 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.332555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38c6890b-942a-4e42-95ba-129771debc17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38c6890b-942a-4e42-95ba-129771debc17" (UID: "38c6890b-942a-4e42-95ba-129771debc17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:44:34.332841 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.332817    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38c6890b-942a-4e42-95ba-129771debc17-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:34.334458 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.334434    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38c6890b-942a-4e42-95ba-129771debc17-kube-api-access-5d6hx" (OuterVolumeSpecName: "kube-api-access-5d6hx") pod "38c6890b-942a-4e42-95ba-129771debc17" (UID: "38c6890b-942a-4e42-95ba-129771debc17"). InnerVolumeSpecName "kube-api-access-5d6hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:44:34.334556 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.334453    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38c6890b-942a-4e42-95ba-129771debc17" (UID: "38c6890b-942a-4e42-95ba-129771debc17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:34.334556 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.334437    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "38c6890b-942a-4e42-95ba-129771debc17" (UID: "38c6890b-942a-4e42-95ba-129771debc17"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:44:34.422639 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.422611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:34.433837 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.433812    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:34.433837 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.433835    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38c6890b-942a-4e42-95ba-129771debc17-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:34.433956 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.433844    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d6hx\" (UniqueName: \"kubernetes.io/projected/38c6890b-942a-4e42-95ba-129771debc17-kube-api-access-5d6hx\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:44:34.579550 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.579513    2564 generic.go:356] "Generic (PLEG): container finished" podID="38c6890b-942a-4e42-95ba-129771debc17" containerID="e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116" exitCode=0
Sep 18 13:44:34.579718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.579559    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"
Sep 18 13:44:34.579718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.579579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" event={"ID":"38c6890b-942a-4e42-95ba-129771debc17","Type":"ContainerDied","Data":"e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116"}
Sep 18 13:44:34.579718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.579637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m" event={"ID":"38c6890b-942a-4e42-95ba-129771debc17","Type":"ContainerDied","Data":"5a44a82edc40dd6edf3fcbad7a9d328d9d54b8a02139fd1f15b7cfb241291373"}
Sep 18 13:44:34.579718 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.579661    2564 scope.go:117] "RemoveContainer" containerID="e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116"
Sep 18 13:44:34.598163 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.598125    2564 scope.go:117] "RemoveContainer" containerID="e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116"
Sep 18 13:44:34.598545 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:44:34.598521    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116\": container with ID starting with e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116 not found: ID does not exist" containerID="e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116"
Sep 18 13:44:34.598615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.598563    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116"} err="failed to get container status \"e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116\": rpc error: code = NotFound desc = could not find container \"e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116\": container with ID starting with e5633ba19f8ebc02198e640c0a4c66bcc4713f6e1bf1faf46ab184f9508a6116 not found: ID does not exist"
Sep 18 13:44:34.624455 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.624416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:34.647308 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.647260    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"]
Sep 18 13:44:34.669750 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:34.669724    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-92b54f-84947f7796-6mk5m"]
Sep 18 13:44:35.013023 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:35.012992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:35.182272 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:35.182222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:35.216372 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:35.216340    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38c6890b-942a-4e42-95ba-129771debc17" path="/var/lib/kubelet/pods/38c6890b-942a-4e42-95ba-129771debc17/volumes"
Sep 18 13:44:35.405392 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:35.405267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:36.827466 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:36.827428    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:36.964020 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:36.963982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:38.284482 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:38.284448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:39.325410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:39.325374    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:41.760966 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:41.760891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:41.883158 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:41.883115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:42.081847 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:42.081765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:43.284380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:43.284353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:44:43.285676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:43.285650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:44:43.816324 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:43.816291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:58.225604 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:58.225569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:58.346781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:58.346744    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:59.295495 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:44:59.295452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:00.520178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:00.520141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:01.451320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:01.451287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:02.550696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:02.550652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:03.630289 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:03.630251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:04.461710 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:04.461674    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"]
Sep 18 13:45:04.594630 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:04.594592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.240053 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.240018    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"]
Sep 18 13:45:15.240471 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.240246    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" podUID="58b3a975-d653-4f3e-93a0-2eece42baa66" containerName="maas-api" containerID="cri-o://a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a" gracePeriod=30
Sep 18 13:45:15.302387 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.302352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.506083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.506020    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:45:15.542301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.542263    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.634309 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.634276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-metrics-certs\") pod \"58b3a975-d653-4f3e-93a0-2eece42baa66\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") "
Sep 18 13:45:15.634509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.634370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjqhp\" (UniqueName: \"kubernetes.io/projected/58b3a975-d653-4f3e-93a0-2eece42baa66-kube-api-access-xjqhp\") pod \"58b3a975-d653-4f3e-93a0-2eece42baa66\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") "
Sep 18 13:45:15.634584 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.634546    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls\") pod \"58b3a975-d653-4f3e-93a0-2eece42baa66\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") "
Sep 18 13:45:15.634676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.634648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b3a975-d653-4f3e-93a0-2eece42baa66-openshift-service-ca\") pod \"58b3a975-d653-4f3e-93a0-2eece42baa66\" (UID: \"58b3a975-d653-4f3e-93a0-2eece42baa66\") "
Sep 18 13:45:15.635089 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.635061    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b3a975-d653-4f3e-93a0-2eece42baa66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58b3a975-d653-4f3e-93a0-2eece42baa66" (UID: "58b3a975-d653-4f3e-93a0-2eece42baa66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:45:15.636963 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.636940    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "58b3a975-d653-4f3e-93a0-2eece42baa66" (UID: "58b3a975-d653-4f3e-93a0-2eece42baa66"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:45:15.637055 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.636982    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58b3a975-d653-4f3e-93a0-2eece42baa66" (UID: "58b3a975-d653-4f3e-93a0-2eece42baa66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:45:15.637055 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.637023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b3a975-d653-4f3e-93a0-2eece42baa66-kube-api-access-xjqhp" (OuterVolumeSpecName: "kube-api-access-xjqhp") pod "58b3a975-d653-4f3e-93a0-2eece42baa66" (UID: "58b3a975-d653-4f3e-93a0-2eece42baa66"). InnerVolumeSpecName "kube-api-access-xjqhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:45:15.689296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.689256    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.736435 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.736350    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjqhp\" (UniqueName: \"kubernetes.io/projected/58b3a975-d653-4f3e-93a0-2eece42baa66-kube-api-access-xjqhp\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:15.736435 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.736382    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:15.736435 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.736399    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b3a975-d653-4f3e-93a0-2eece42baa66-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:15.736435 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.736412    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b3a975-d653-4f3e-93a0-2eece42baa66-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:15.789015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.788917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.843371 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.843330    2564 generic.go:356] "Generic (PLEG): container finished" podID="58b3a975-d653-4f3e-93a0-2eece42baa66" containerID="a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a" exitCode=0
Sep 18 13:45:15.843564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.843383    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"
Sep 18 13:45:15.843564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.843421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" event={"ID":"58b3a975-d653-4f3e-93a0-2eece42baa66","Type":"ContainerDied","Data":"a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a"}
Sep 18 13:45:15.843564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.843494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv" event={"ID":"58b3a975-d653-4f3e-93a0-2eece42baa66","Type":"ContainerDied","Data":"7c58f2dcf711ea0b4bde8fda48d0762a871f677e2d2a3c29e1141e97d17fc015"}
Sep 18 13:45:15.843564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.843520    2564 scope.go:117] "RemoveContainer" containerID="a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a"
Sep 18 13:45:15.854083 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.854062    2564 scope.go:117] "RemoveContainer" containerID="a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a"
Sep 18 13:45:15.854709 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:15.854684    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a\": container with ID starting with a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a not found: ID does not exist" containerID="a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a"
Sep 18 13:45:15.854809 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.854718    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a"} err="failed to get container status \"a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a\": rpc error: code = NotFound desc = could not find container \"a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a\": container with ID starting with a9d764746d2f53ad191347a0e3f53cf7a4f5a27f97abf8ea04494000d947174a not found: ID does not exist"
Sep 18 13:45:15.873000 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.872931    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"]
Sep 18 13:45:15.879126 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:15.879092    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-5be8a3-57b5dc4995-2kwzv"]
Sep 18 13:45:16.069695 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:16.069607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:16.181069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:16.181030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:17.200443 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.200411    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:17.216771 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.216741    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b3a975-d653-4f3e-93a0-2eece42baa66" path="/var/lib/kubelet/pods/58b3a975-d653-4f3e-93a0-2eece42baa66/volumes"
Sep 18 13:45:17.741672 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.741637    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7469-7fbcc7"]
Sep 18 13:45:17.742058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742046    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71dca6fc-5da8-4dd4-868d-c3318785ab21" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742059    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71dca6fc-5da8-4dd4-868d-c3318785ab21" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742074    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742080    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742088    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38c6890b-942a-4e42-95ba-129771debc17" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742093    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38c6890b-942a-4e42-95ba-129771debc17" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742100    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7123c-54ca-46d8-9010-69323e6a5fad" containerName="maas-api"
Sep 18 13:45:17.742106 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742105    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7123c-54ca-46d8-9010-69323e6a5fad" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742118    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b3a975-d653-4f3e-93a0-2eece42baa66" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742124    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b3a975-d653-4f3e-93a0-2eece42baa66" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742130    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" containerName="main"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742136    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" containerName="main"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742141    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419ebfc5-6dea-4e40-9b12-28b433d11ff8" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742146    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="419ebfc5-6dea-4e40-9b12-28b433d11ff8" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742240    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38c6890b-942a-4e42-95ba-129771debc17" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742251    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb7123c-54ca-46d8-9010-69323e6a5fad" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742257    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7438b1d1-6cbe-4aeb-9c58-e4f00858bf6d" containerName="main"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742263    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b3a975-d653-4f3e-93a0-2eece42baa66" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742268    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="419ebfc5-6dea-4e40-9b12-28b433d11ff8" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742273    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71dca6fc-5da8-4dd4-868d-c3318785ab21" containerName="maas-api"
Sep 18 13:45:17.742342 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.742279    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4381556-6258-4ecb-ab85-4f4d3d6800e4" containerName="maas-api"
Sep 18 13:45:17.745458 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.745438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:17.748939 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.748920    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncnrt\""
Sep 18 13:45:17.754416 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.754389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7469-7fbcc7"]
Sep 18 13:45:17.856114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.856086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grv2\" (UniqueName: \"kubernetes.io/projected/3ab27678-5941-4d62-bcbd-5f0cab397037-kube-api-access-8grv2\") pod \"test-curl-7469-7fbcc7\" (UID: \"3ab27678-5941-4d62-bcbd-5f0cab397037\") " pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:17.956981 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.956953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8grv2\" (UniqueName: \"kubernetes.io/projected/3ab27678-5941-4d62-bcbd-5f0cab397037-kube-api-access-8grv2\") pod \"test-curl-7469-7fbcc7\" (UID: \"3ab27678-5941-4d62-bcbd-5f0cab397037\") " pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:17.967764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:17.967743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grv2\" (UniqueName: \"kubernetes.io/projected/3ab27678-5941-4d62-bcbd-5f0cab397037-kube-api-access-8grv2\") pod \"test-curl-7469-7fbcc7\" (UID: \"3ab27678-5941-4d62-bcbd-5f0cab397037\") " pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:18.056169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:18.056077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:18.126205 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:18.126160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:18.336413 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:18.336336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7469-7fbcc7"]
Sep 18 13:45:18.339511 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:45:18.339488    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ab27678_5941_4d62_bcbd_5f0cab397037.slice/crio-62c081a4359446d501e622da6495e5564c008ccf8250ec5d74d54d6b59482510 WatchSource:0}: Error finding container 62c081a4359446d501e622da6495e5564c008ccf8250ec5d74d54d6b59482510: Status 404 returned error can't find the container with id 62c081a4359446d501e622da6495e5564c008ccf8250ec5d74d54d6b59482510
Sep 18 13:45:18.863725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:18.863692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7469-7fbcc7" event={"ID":"3ab27678-5941-4d62-bcbd-5f0cab397037","Type":"ContainerStarted","Data":"608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a"}
Sep 18 13:45:18.863725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:18.863733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7469-7fbcc7" event={"ID":"3ab27678-5941-4d62-bcbd-5f0cab397037","Type":"ContainerStarted","Data":"62c081a4359446d501e622da6495e5564c008ccf8250ec5d74d54d6b59482510"}
Sep 18 13:45:18.881080 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:18.881037    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7469-7fbcc7" podStartSLOduration=1.881019796 podStartE2EDuration="1.881019796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:18.880770487 +0000 UTC m=+1836.250029868" watchObservedRunningTime="2026-09-18 13:45:18.881019796 +0000 UTC m=+1836.250279179"
Sep 18 13:45:19.481216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.481147    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf" podUID="36ee12f5-2e46-4a94-a24f-97c55084bd84" containerName="main" containerID="cri-o://7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d" gracePeriod=45
Sep 18 13:45:19.514468 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.514442    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7469-7fbcc7"]
Sep 18 13:45:19.521348 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.521328    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7469-7fbcc7"]
Sep 18 13:45:19.737320 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.737298    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:45:19.870440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.870362    2564 generic.go:356] "Generic (PLEG): container finished" podID="36ee12f5-2e46-4a94-a24f-97c55084bd84" containerID="7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d" exitCode=0
Sep 18 13:45:19.870440 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.870400    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"
Sep 18 13:45:19.870615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.870447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf" event={"ID":"36ee12f5-2e46-4a94-a24f-97c55084bd84","Type":"ContainerDied","Data":"7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d"}
Sep 18 13:45:19.870615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.870488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf" event={"ID":"36ee12f5-2e46-4a94-a24f-97c55084bd84","Type":"ContainerDied","Data":"bfbe19acb9b505fbea9ad8c9d2d54dde2dc0762ccc8171c88a2436feb22e3d65"}
Sep 18 13:45:19.870615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.870510    2564 scope.go:117] "RemoveContainer" containerID="7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d"
Sep 18 13:45:19.870887 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:19.870863    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7469-7fbcc7" container="test-curl-7469-7fbcc7"
Sep 18 13:45:19.874792 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.874776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ee12f5-2e46-4a94-a24f-97c55084bd84-tls-certs\") pod \"36ee12f5-2e46-4a94-a24f-97c55084bd84\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") "
Sep 18 13:45:19.874896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.874805    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-tmp-dir\") pod \"36ee12f5-2e46-4a94-a24f-97c55084bd84\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") "
Sep 18 13:45:19.874896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.874823    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5bpn\" (UniqueName: \"kubernetes.io/projected/36ee12f5-2e46-4a94-a24f-97c55084bd84-kube-api-access-l5bpn\") pod \"36ee12f5-2e46-4a94-a24f-97c55084bd84\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") "
Sep 18 13:45:19.874896 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.874856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-dshm\") pod \"36ee12f5-2e46-4a94-a24f-97c55084bd84\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") "
Sep 18 13:45:19.875069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.874954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-model-cache\") pod \"36ee12f5-2e46-4a94-a24f-97c55084bd84\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") "
Sep 18 13:45:19.875069 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.874976    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-home\") pod \"36ee12f5-2e46-4a94-a24f-97c55084bd84\" (UID: \"36ee12f5-2e46-4a94-a24f-97c55084bd84\") "
Sep 18 13:45:19.875177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.875082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36ee12f5-2e46-4a94-a24f-97c55084bd84" (UID: "36ee12f5-2e46-4a94-a24f-97c55084bd84"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:19.875385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.875355    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-tmp-dir\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:19.875529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.875508    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-home" (OuterVolumeSpecName: "home") pod "36ee12f5-2e46-4a94-a24f-97c55084bd84" (UID: "36ee12f5-2e46-4a94-a24f-97c55084bd84"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:19.875593 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.875576    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-model-cache" (OuterVolumeSpecName: "model-cache") pod "36ee12f5-2e46-4a94-a24f-97c55084bd84" (UID: "36ee12f5-2e46-4a94-a24f-97c55084bd84"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:19.877052 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.877021    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ee12f5-2e46-4a94-a24f-97c55084bd84-kube-api-access-l5bpn" (OuterVolumeSpecName: "kube-api-access-l5bpn") pod "36ee12f5-2e46-4a94-a24f-97c55084bd84" (UID: "36ee12f5-2e46-4a94-a24f-97c55084bd84"). InnerVolumeSpecName "kube-api-access-l5bpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:45:19.877142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.877092    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ee12f5-2e46-4a94-a24f-97c55084bd84-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36ee12f5-2e46-4a94-a24f-97c55084bd84" (UID: "36ee12f5-2e46-4a94-a24f-97c55084bd84"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:45:19.877142 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.877105    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-dshm" (OuterVolumeSpecName: "dshm") pod "36ee12f5-2e46-4a94-a24f-97c55084bd84" (UID: "36ee12f5-2e46-4a94-a24f-97c55084bd84"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:19.879742 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.879722    2564 scope.go:117] "RemoveContainer" containerID="7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d"
Sep 18 13:45:19.880056 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:19.880035    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d\": container with ID starting with 7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d not found: ID does not exist" containerID="7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d"
Sep 18 13:45:19.880113 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.880068    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d"} err="failed to get container status \"7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d\": rpc error: code = NotFound desc = could not find container \"7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d\": container with ID starting with 7f128a5921cd659b69417580ca7f936cd07e90e136cf4f1bc6e2cb18699e465d not found: ID does not exist"
Sep 18 13:45:19.976553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.976527    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ee12f5-2e46-4a94-a24f-97c55084bd84-tls-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:19.976553 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.976551    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5bpn\" (UniqueName: \"kubernetes.io/projected/36ee12f5-2e46-4a94-a24f-97c55084bd84-kube-api-access-l5bpn\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:19.976717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.976561    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-dshm\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:19.976717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.976569    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-model-cache\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:19.976717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:19.976578    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ee12f5-2e46-4a94-a24f-97c55084bd84-home\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:20.200329 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:20.200285    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"]
Sep 18 13:45:20.202774 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:20.202750    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-5be8a3/simulator-w5-5be8a3-kserve-7fddd58d8-njdpf"]
Sep 18 13:45:20.885222 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:20.885150    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7469-7fbcc7" podUID="3ab27678-5941-4d62-bcbd-5f0cab397037" containerName="test-curl-7469-7fbcc7" containerID="cri-o://608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a" gracePeriod=2
Sep 18 13:45:20.887823 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:20.887799    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7469-7fbcc7\" is forbidden: User \"system:node:ip-10-0-136-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-225.ec2.internal' and this object" podUID="3ab27678-5941-4d62-bcbd-5f0cab397037" pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:21.217794 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:21.217698    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ee12f5-2e46-4a94-a24f-97c55084bd84" path="/var/lib/kubelet/pods/36ee12f5-2e46-4a94-a24f-97c55084bd84/volumes"
Sep 18 13:45:21.421091 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:21.421058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:22.588725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:22.588692    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:22.687871 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:22.687840    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:22.826411 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:22.826371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:22.853704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:22.853624    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"]
Sep 18 13:45:22.853886 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:22.853859    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy" containerID="cri-o://f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0" gracePeriod=30
Sep 18 13:45:22.934722 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:22.934695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:23.076408 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.076382    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:23.207993 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.207915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8grv2\" (UniqueName: \"kubernetes.io/projected/3ab27678-5941-4d62-bcbd-5f0cab397037-kube-api-access-8grv2\") pod \"3ab27678-5941-4d62-bcbd-5f0cab397037\" (UID: \"3ab27678-5941-4d62-bcbd-5f0cab397037\") "
Sep 18 13:45:23.209960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.209931    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab27678-5941-4d62-bcbd-5f0cab397037-kube-api-access-8grv2" (OuterVolumeSpecName: "kube-api-access-8grv2") pod "3ab27678-5941-4d62-bcbd-5f0cab397037" (UID: "3ab27678-5941-4d62-bcbd-5f0cab397037"). InnerVolumeSpecName "kube-api-access-8grv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:45:23.214634 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.214610    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ab27678-5941-4d62-bcbd-5f0cab397037" path="/var/lib/kubelet/pods/3ab27678-5941-4d62-bcbd-5f0cab397037/volumes"
Sep 18 13:45:23.309521 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.309490    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8grv2\" (UniqueName: \"kubernetes.io/projected/3ab27678-5941-4d62-bcbd-5f0cab397037-kube-api-access-8grv2\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:23.908862 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.908829    2564 generic.go:356] "Generic (PLEG): container finished" podID="3ab27678-5941-4d62-bcbd-5f0cab397037" containerID="608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a" exitCode=137
Sep 18 13:45:23.908862 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.908865    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-7fbcc7"
Sep 18 13:45:23.909356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.908931    2564 scope.go:117] "RemoveContainer" containerID="608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a"
Sep 18 13:45:23.917605 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.917588    2564 scope.go:117] "RemoveContainer" containerID="608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a"
Sep 18 13:45:23.917898 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:23.917875    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a\": container with ID starting with 608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a not found: ID does not exist" containerID="608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a"
Sep 18 13:45:23.917959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:23.917906    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a"} err="failed to get container status \"608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a\": rpc error: code = NotFound desc = could not find container \"608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a\": container with ID starting with 608936e9156dfb5039c5bfb791f956019d85af63e0ca73a5a370fd762e9dd00a not found: ID does not exist"
Sep 18 13:45:28.106564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.106542    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:45:28.252548 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-certs\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-podinfo\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252608    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-token\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252639    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-data\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252654    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-socket\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252704 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252669    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgs9h\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-kube-api-access-vgs9h\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252726    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istiod-ca-cert\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252783    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-credential-socket\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252806    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-envoy\") pod \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\" (UID: \"648845bb-17b9-4d7d-b0a5-f3a50481de8b\") "
Sep 18 13:45:28.252988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252819    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:28.252988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252950    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:28.252988 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.252966    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:28.253275 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.253088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:28.253275 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.253138    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:45:28.253275 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.253156    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.253275 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.253174    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-data\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.253275 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.253187    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-workload-socket\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.254980 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.254958    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:45:28.255064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.255043    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-kube-api-access-vgs9h" (OuterVolumeSpecName: "kube-api-access-vgs9h") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "kube-api-access-vgs9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:45:28.255276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.255254    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:45:28.255375 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.255277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "648845bb-17b9-4d7d-b0a5-f3a50481de8b" (UID: "648845bb-17b9-4d7d-b0a5-f3a50481de8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 13:45:28.354014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.353972    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istiod-ca-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.354014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.354008    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-credential-socket\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.354014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.354018    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-envoy\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.354014 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.354027    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-podinfo\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.354298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.354035    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-istio-token\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.354298 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.354043    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgs9h\" (UniqueName: \"kubernetes.io/projected/648845bb-17b9-4d7d-b0a5-f3a50481de8b-kube-api-access-vgs9h\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:45:28.940662 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.940630    2564 generic.go:356] "Generic (PLEG): container finished" podID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerID="f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0" exitCode=0
Sep 18 13:45:28.940859 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.940680    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"
Sep 18 13:45:28.940859 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.940721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" event={"ID":"648845bb-17b9-4d7d-b0a5-f3a50481de8b","Type":"ContainerDied","Data":"f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0"}
Sep 18 13:45:28.940859 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.940786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67" event={"ID":"648845bb-17b9-4d7d-b0a5-f3a50481de8b","Type":"ContainerDied","Data":"cda768867d4f9e7d2ee641ff8f40f21f747f49b3801cad20ee715d3828a3b087"}
Sep 18 13:45:28.940859 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.940817    2564 scope.go:117] "RemoveContainer" containerID="f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0"
Sep 18 13:45:28.951099 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.951083    2564 scope.go:117] "RemoveContainer" containerID="aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"
Sep 18 13:45:28.959603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.959564    2564 scope.go:117] "RemoveContainer" containerID="f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0"
Sep 18 13:45:28.959836 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:28.959809    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0\": container with ID starting with f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0 not found: ID does not exist" containerID="f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0"
Sep 18 13:45:28.959920 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.959846    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0"} err="failed to get container status \"f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0\": rpc error: code = NotFound desc = could not find container \"f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0\": container with ID starting with f7eb41b7187957b2beac1a0c023f2d42907970868cb976843aad173a6d4c2ef0 not found: ID does not exist"
Sep 18 13:45:28.959920 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.959871    2564 scope.go:117] "RemoveContainer" containerID="aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"
Sep 18 13:45:28.960178 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:45:28.960160    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556\": container with ID starting with aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556 not found: ID does not exist" containerID="aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"
Sep 18 13:45:28.960276 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.960183    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556"} err="failed to get container status \"aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556\": rpc error: code = NotFound desc = could not find container \"aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556\": container with ID starting with aab4fadbc4eca091612bda6eb32ca3c1a2e04737f4f785ec817766a3b14e8556 not found: ID does not exist"
Sep 18 13:45:28.965077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.965055    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"]
Sep 18 13:45:28.970657 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:28.970637    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67"]
Sep 18 13:45:29.216338 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:29.216264    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" path="/var/lib/kubelet/pods/648845bb-17b9-4d7d-b0a5-f3a50481de8b/volumes"
Sep 18 13:45:36.247182 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:36.247147    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:39.966124 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:39.966085    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:40.818926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:40.818889    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:40.919829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:40.919793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:42.806520 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:42.806484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:59.600077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:45:59.600037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:03.578868 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:03.578825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:05.653558 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:05.653519    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:36.702266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702230    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7469-4e321b"]
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702622    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab27678-5941-4d62-bcbd-5f0cab397037" containerName="test-curl-7469-7fbcc7"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702634    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab27678-5941-4d62-bcbd-5f0cab397037" containerName="test-curl-7469-7fbcc7"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702648    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702653    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702661    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ee12f5-2e46-4a94-a24f-97c55084bd84" containerName="main"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702667    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ee12f5-2e46-4a94-a24f-97c55084bd84" containerName="main"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702677    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy"
Sep 18 13:46:36.702723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702682    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy"
Sep 18 13:46:36.703013 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702743    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ab27678-5941-4d62-bcbd-5f0cab397037" containerName="test-curl-7469-7fbcc7"
Sep 18 13:46:36.703013 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702753    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy"
Sep 18 13:46:36.703013 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702758    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ee12f5-2e46-4a94-a24f-97c55084bd84" containerName="main"
Sep 18 13:46:36.703013 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.702764    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="648845bb-17b9-4d7d-b0a5-f3a50481de8b" containerName="istio-proxy"
Sep 18 13:46:36.705919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.705904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:36.708620 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.708604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncnrt\""
Sep 18 13:46:36.714582 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.714560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7469-4e321b"]
Sep 18 13:46:36.787569 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.787539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj6fj\" (UniqueName: \"kubernetes.io/projected/5fbd7c51-c845-4446-968d-226a21a1ae20-kube-api-access-rj6fj\") pod \"test-curl-7469-4e321b\" (UID: \"5fbd7c51-c845-4446-968d-226a21a1ae20\") " pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:36.888331 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.888303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6fj\" (UniqueName: \"kubernetes.io/projected/5fbd7c51-c845-4446-968d-226a21a1ae20-kube-api-access-rj6fj\") pod \"test-curl-7469-4e321b\" (UID: \"5fbd7c51-c845-4446-968d-226a21a1ae20\") " pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:36.897485 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:36.897463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj6fj\" (UniqueName: \"kubernetes.io/projected/5fbd7c51-c845-4446-968d-226a21a1ae20-kube-api-access-rj6fj\") pod \"test-curl-7469-4e321b\" (UID: \"5fbd7c51-c845-4446-968d-226a21a1ae20\") " pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:37.015339 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:37.015317    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:37.288747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:37.288712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7469-4e321b"]
Sep 18 13:46:37.289261 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:46:37.289239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fbd7c51_c845_4446_968d_226a21a1ae20.slice/crio-06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921 WatchSource:0}: Error finding container 06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921: Status 404 returned error can't find the container with id 06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921
Sep 18 13:46:37.341747 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:37.341721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7469-4e321b" event={"ID":"5fbd7c51-c845-4446-968d-226a21a1ae20","Type":"ContainerStarted","Data":"06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921"}
Sep 18 13:46:38.350080 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:38.350043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7469-4e321b" event={"ID":"5fbd7c51-c845-4446-968d-226a21a1ae20","Type":"ContainerStarted","Data":"0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9"}
Sep 18 13:46:38.959724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:38.959656    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7469-4e321b" podStartSLOduration=2.959632621 podStartE2EDuration="2.959632621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:38.364832851 +0000 UTC m=+1915.734092234" watchObservedRunningTime="2026-09-18 13:46:38.959632621 +0000 UTC m=+1916.328892004"
Sep 18 13:46:38.960687 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:38.960637    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7469-4e321b"]
Sep 18 13:46:38.964562 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:38.964534    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7469-4e321b"]
Sep 18 13:46:39.075840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.075765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7469-607efc"]
Sep 18 13:46:39.076228 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.076213    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fbd7c51-c845-4446-968d-226a21a1ae20" containerName="test-curl-7469-4e321b"
Sep 18 13:46:39.076285 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.076229    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fbd7c51-c845-4446-968d-226a21a1ae20" containerName="test-curl-7469-4e321b"
Sep 18 13:46:39.076322 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.076304    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fbd7c51-c845-4446-968d-226a21a1ae20" containerName="test-curl-7469-4e321b"
Sep 18 13:46:39.079141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.079125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:39.085679 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.085654    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7469-607efc"]
Sep 18 13:46:39.107502 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.107478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd25f\" (UniqueName: \"kubernetes.io/projected/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83-kube-api-access-vd25f\") pod \"test-curl-7469-607efc\" (UID: \"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83\") " pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:39.208505 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.208468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd25f\" (UniqueName: \"kubernetes.io/projected/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83-kube-api-access-vd25f\") pod \"test-curl-7469-607efc\" (UID: \"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83\") " pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:39.217673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.217646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd25f\" (UniqueName: \"kubernetes.io/projected/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83-kube-api-access-vd25f\") pod \"test-curl-7469-607efc\" (UID: \"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83\") " pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:39.355740 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:46:39.355669    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7469-4e321b" container="test-curl-7469-4e321b"
Sep 18 13:46:39.390447 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.390425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:39.666628 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:39.666597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7469-607efc"]
Sep 18 13:46:39.666791 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:46:39.666765    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e1e3f6c_87b3_4efb_9ec4_f9e6b835dd83.slice/crio-b3b106d157d32e1c289c99ef0ffbdeb6dcc4cb425566f43233de931304f8b448 WatchSource:0}: Error finding container b3b106d157d32e1c289c99ef0ffbdeb6dcc4cb425566f43233de931304f8b448: Status 404 returned error can't find the container with id b3b106d157d32e1c289c99ef0ffbdeb6dcc4cb425566f43233de931304f8b448
Sep 18 13:46:40.363299 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:40.363265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7469-607efc" event={"ID":"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83","Type":"ContainerStarted","Data":"eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123"}
Sep 18 13:46:40.363743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:40.363312    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7469-607efc" event={"ID":"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83","Type":"ContainerStarted","Data":"b3b106d157d32e1c289c99ef0ffbdeb6dcc4cb425566f43233de931304f8b448"}
Sep 18 13:46:40.363743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:40.363443    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7469-4e321b" podUID="5fbd7c51-c845-4446-968d-226a21a1ae20" containerName="test-curl-7469-4e321b" containerID="cri-o://0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9" gracePeriod=2
Sep 18 13:46:40.400364 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:40.400319    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7469-607efc" podStartSLOduration=1.400304982 podStartE2EDuration="1.400304982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:46:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:40.396094368 +0000 UTC m=+1917.765353753" watchObservedRunningTime="2026-09-18 13:46:40.400304982 +0000 UTC m=+1917.769564364"
Sep 18 13:46:41.089209 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:41.089095    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7469-607efc"]
Sep 18 13:46:41.092871 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:41.092844    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7469-607efc"]
Sep 18 13:46:41.369972 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:46:41.369887    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7469-607efc" container="test-curl-7469-607efc"
Sep 18 13:46:42.376767 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:42.376735    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7469-607efc" podUID="0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" containerName="test-curl-7469-607efc" containerID="cri-o://eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123" gracePeriod=2
Sep 18 13:46:42.556481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:42.556457    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:42.635930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:42.635871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj6fj\" (UniqueName: \"kubernetes.io/projected/5fbd7c51-c845-4446-968d-226a21a1ae20-kube-api-access-rj6fj\") pod \"5fbd7c51-c845-4446-968d-226a21a1ae20\" (UID: \"5fbd7c51-c845-4446-968d-226a21a1ae20\") "
Sep 18 13:46:42.637866 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:42.637844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fbd7c51-c845-4446-968d-226a21a1ae20-kube-api-access-rj6fj" (OuterVolumeSpecName: "kube-api-access-rj6fj") pod "5fbd7c51-c845-4446-968d-226a21a1ae20" (UID: "5fbd7c51-c845-4446-968d-226a21a1ae20"). InnerVolumeSpecName "kube-api-access-rj6fj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:42.737168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:42.737141    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj6fj\" (UniqueName: \"kubernetes.io/projected/5fbd7c51-c845-4446-968d-226a21a1ae20-kube-api-access-rj6fj\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:46:43.215525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.215494    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fbd7c51-c845-4446-968d-226a21a1ae20" path="/var/lib/kubelet/pods/5fbd7c51-c845-4446-968d-226a21a1ae20/volumes"
Sep 18 13:46:43.231698 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.231674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:43.383736 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.383701    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fbd7c51-c845-4446-968d-226a21a1ae20" containerID="0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9" exitCode=137
Sep 18 13:46:43.384161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.383741    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-4e321b"
Sep 18 13:46:43.384161 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.383782    2564 scope.go:117] "RemoveContainer" containerID="0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9"
Sep 18 13:46:43.392648 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.392634    2564 scope.go:117] "RemoveContainer" containerID="0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9"
Sep 18 13:46:43.392914 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:46:43.392896    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9\": container with ID starting with 0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9 not found: ID does not exist" containerID="0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9"
Sep 18 13:46:43.392979 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:43.392925    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9"} err="failed to get container status \"0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9\": rpc error: code = NotFound desc = could not find container \"0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9\": container with ID starting with 0aadabe31e1a1d63db44c683d98d6c7325e18bfe68176df0a55275fd7251b5b9 not found: ID does not exist"
Sep 18 13:46:44.182211 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:44.182153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:44.429550 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:46:44.429521    2564 manager.go:1116] Failed to create existing container: /kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fbd7c51_c845_4446_968d_226a21a1ae20.slice/crio-06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921: Error finding container 06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921: Status 404 returned error can't find the container with id 06dbed43a474420dc50a206298721d7eeabd2b7e228a418810b0093fa538c921
Sep 18 13:46:44.564751 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:44.564727    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:44.655109 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:44.655072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd25f\" (UniqueName: \"kubernetes.io/projected/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83-kube-api-access-vd25f\") pod \"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83\" (UID: \"0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83\") "
Sep 18 13:46:44.657204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:44.657174    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83-kube-api-access-vd25f" (OuterVolumeSpecName: "kube-api-access-vd25f") pod "0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" (UID: "0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83"). InnerVolumeSpecName "kube-api-access-vd25f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:44.756844 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:44.756814    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd25f\" (UniqueName: \"kubernetes.io/projected/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83-kube-api-access-vd25f\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:46:45.214729 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:45.214647    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" path="/var/lib/kubelet/pods/0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83/volumes"
Sep 18 13:46:45.396489 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:45.396455    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" containerID="eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123" exitCode=137
Sep 18 13:46:45.396678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:45.396511    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7469-607efc"
Sep 18 13:46:45.396678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:45.396515    2564 scope.go:117] "RemoveContainer" containerID="eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123"
Sep 18 13:46:45.406310 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:45.406293    2564 scope.go:117] "RemoveContainer" containerID="eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123"
Sep 18 13:46:45.406571 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:46:45.406553    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123\": container with ID starting with eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123 not found: ID does not exist" containerID="eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123"
Sep 18 13:46:45.406622 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:45.406577    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123"} err="failed to get container status \"eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123\": rpc error: code = NotFound desc = could not find container \"eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123\": container with ID starting with eb6e798c7bc2e39f8bd6e9a75d596268eedbb1edeb8da0b0097b52aae4470123 not found: ID does not exist"
Sep 18 13:46:48.893277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:46:48.893246    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:14.416576 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:14.416535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:25.641793 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:25.641750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:35.823153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:35.823062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:35.884110 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:35.884076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:47.681672 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:47.681632    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:48.761772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:48.761721    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:49.237913 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:49.237879    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:49.676057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:49.675963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:51.016115 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:51.016081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:52.597238 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:52.597181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:52.737395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:52.737362    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:54.024425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.024388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:54.946364 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.946335    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"]
Sep 18 13:47:54.946765 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.946751    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" containerName="test-curl-7469-607efc"
Sep 18 13:47:54.946829 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.946765    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" containerName="test-curl-7469-607efc"
Sep 18 13:47:54.946869 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.946836    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e1e3f6c-87b3-4efb-9ec4-f9e6b835dd83" containerName="test-curl-7469-607efc"
Sep 18 13:47:54.950018 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.949997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:54.953152 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.953131    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-2dd8de-serving-cert\""
Sep 18 13:47:54.963383 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.963359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"]
Sep 18 13:47:54.992258 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:54.992229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:55.009644 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.009616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5decd604-936d-4afd-b76f-b366def574b1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.009644 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.009643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-metrics-certs\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.009801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.009674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.009801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.009754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8c77\" (UniqueName: \"kubernetes.io/projected/5decd604-936d-4afd-b76f-b366def574b1-kube-api-access-p8c77\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.092210 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.092156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:55.110811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.110788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5decd604-936d-4afd-b76f-b366def574b1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.110927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.110814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-metrics-certs\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.110927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.110844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.110927 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.110866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8c77\" (UniqueName: \"kubernetes.io/projected/5decd604-936d-4afd-b76f-b366def574b1-kube-api-access-p8c77\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.111047 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:47:55.110940    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-serving-cert: secret "maas-api-e2e-ipp-a-2dd8de-serving-cert" not found
Sep 18 13:47:55.111047 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:47:55.111017    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls podName:5decd604-936d-4afd-b76f-b366def574b1 nodeName:}" failed. No retries permitted until 2026-09-18 13:47:55.611002178 +0000 UTC m=+1992.980261537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls") pod "maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" (UID: "5decd604-936d-4afd-b76f-b366def574b1") : secret "maas-api-e2e-ipp-a-2dd8de-serving-cert" not found
Sep 18 13:47:55.111618 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.111600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5decd604-936d-4afd-b76f-b366def574b1-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.113181 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.113164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-metrics-certs\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.126753 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.126734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8c77\" (UniqueName: \"kubernetes.io/projected/5decd604-936d-4afd-b76f-b366def574b1-kube-api-access-p8c77\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.342270 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.342221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:55.614526 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.614448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.616841 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.616821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:55.628652 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.628626    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:55.738716 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.738680    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:55.860870 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:55.860838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:56.144918 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:56.144889    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"]
Sep 18 13:47:56.146513 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:47:56.146481    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5decd604_936d_4afd_b76f_b366def574b1.slice/crio-f64b05c0f23f31977d340b8c41bd058e109426e183d0a9262acf07ed36be8ed9 WatchSource:0}: Error finding container f64b05c0f23f31977d340b8c41bd058e109426e183d0a9262acf07ed36be8ed9: Status 404 returned error can't find the container with id f64b05c0f23f31977d340b8c41bd058e109426e183d0a9262acf07ed36be8ed9
Sep 18 13:47:56.148397 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:56.148375    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:47:56.258064 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:56.258027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:56.813110 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:56.813072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" event={"ID":"5decd604-936d-4afd-b76f-b366def574b1","Type":"ContainerStarted","Data":"f64b05c0f23f31977d340b8c41bd058e109426e183d0a9262acf07ed36be8ed9"}
Sep 18 13:47:57.222497 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:57.222400    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:57.820960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:57.820926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" event={"ID":"5decd604-936d-4afd-b76f-b366def574b1","Type":"ContainerStarted","Data":"ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2"}
Sep 18 13:47:57.821175 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:57.820989    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:47:57.878066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:47:57.878014    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" podStartSLOduration=3.155056824 podStartE2EDuration="3.877999275s" totalImagesPullingTime="722.942451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:47:57.875619206 +0000 UTC m=+1995.244878589" watchObservedRunningTime="2026-09-18 13:47:57.877999275 +0000 UTC m=+1995.247258704"
Sep 18 13:48:03.832827 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:03.832794    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:48:17.824524 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:17.824489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:18.087399 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:18.087314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:18.726489 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:18.726456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:18.831357 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:18.831318    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:19.166658 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:19.166611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:19.326568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:19.326530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:19.869148 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:19.869117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:21.036305 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:21.036274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:22.599153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:22.599123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:23.420736 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:23.420704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:23.774621 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:23.774584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:24.958103 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:24.958057    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:26.483715 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:26.483679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:27.410089 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:27.410039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:28.221755 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.221722    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"]
Sep 18 13:48:28.225611 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.225593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.228787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.228641    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f629bd-serving-cert\""
Sep 18 13:48:28.238222 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.238178    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"]
Sep 18 13:48:28.264029 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.263996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:28.316432 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.316397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fsqn\" (UniqueName: \"kubernetes.io/projected/081ac2f5-5c50-49e0-9538-5a3f8becd42f-kube-api-access-2fsqn\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.316588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.316487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.316588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.316512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-metrics-certs\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.316588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.316584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/081ac2f5-5c50-49e0-9538-5a3f8becd42f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.410769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.410740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:28.417890 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.417867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.417956 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.417907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-metrics-certs\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.417956 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.417948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/081ac2f5-5c50-49e0-9538-5a3f8becd42f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.418026 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.417984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fsqn\" (UniqueName: \"kubernetes.io/projected/081ac2f5-5c50-49e0-9538-5a3f8becd42f-kube-api-access-2fsqn\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.418067 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:48:28.418019    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-serving-cert: secret "maas-api-e2e-ipp-b-f629bd-serving-cert" not found
Sep 18 13:48:28.418111 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:48:28.418086    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls podName:081ac2f5-5c50-49e0-9538-5a3f8becd42f nodeName:}" failed. No retries permitted until 2026-09-18 13:48:28.918065785 +0000 UTC m=+2026.287325145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls") pod "maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" (UID: "081ac2f5-5c50-49e0-9538-5a3f8becd42f") : secret "maas-api-e2e-ipp-b-f629bd-serving-cert" not found
Sep 18 13:48:28.418668 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.418645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/081ac2f5-5c50-49e0-9538-5a3f8becd42f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.420430 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.420412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-metrics-certs\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.429771 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.429751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fsqn\" (UniqueName: \"kubernetes.io/projected/081ac2f5-5c50-49e0-9538-5a3f8becd42f-kube-api-access-2fsqn\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.750814 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.750787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:28.923111 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.923080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.925486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.925463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:28.980090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:28.980059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:29.097787 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:29.097688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:29.137713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:29.137682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:29.419418 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:29.419385    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"]
Sep 18 13:48:29.420808 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:48:29.420781    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081ac2f5_5c50_49e0_9538_5a3f8becd42f.slice/crio-da78460c6e9776855ad2de5247c697cbfcd47371980ce0347300019416d60a37 WatchSource:0}: Error finding container da78460c6e9776855ad2de5247c697cbfcd47371980ce0347300019416d60a37: Status 404 returned error can't find the container with id da78460c6e9776855ad2de5247c697cbfcd47371980ce0347300019416d60a37
Sep 18 13:48:30.006957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:30.006870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" event={"ID":"081ac2f5-5c50-49e0-9538-5a3f8becd42f","Type":"ContainerStarted","Data":"90b42c491c41bc3bd19e958aadf8930b73b88d3c2ff3152068dec82cac460ea0"}
Sep 18 13:48:30.006957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:30.006917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" event={"ID":"081ac2f5-5c50-49e0-9538-5a3f8becd42f","Type":"ContainerStarted","Data":"da78460c6e9776855ad2de5247c697cbfcd47371980ce0347300019416d60a37"}
Sep 18 13:48:30.007172 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:30.006983    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:30.030274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:30.030219    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" podStartSLOduration=1.703987028 podStartE2EDuration="2.030185847s" totalImagesPullingTime="326.198819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:48:30.02914682 +0000 UTC m=+2027.398406200" watchObservedRunningTime="2026-09-18 13:48:30.030185847 +0000 UTC m=+2027.399445230"
Sep 18 13:48:36.018769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:36.018739    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:48:47.401293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:47.401260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:47.496960 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:47.496924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:50.869588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:50.869554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:51.779010 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:51.778971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:52.607525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:52.607495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:53.241615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:53.241579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:53.656617 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:53.656526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:54.714423 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:54.714386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:58.476772 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:48:58.476743    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-hwhcb_578343e7-ca05-4da6-a096-84e93dc0601c/payload-processing/0.log"
Sep 18 13:49:03.442724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:03.442686    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:08.938100 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:08.938012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:09.005789 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:09.005757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:29.758207 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:29.758171    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-hwhcb_578343e7-ca05-4da6-a096-84e93dc0601c/payload-processing/0.log"
Sep 18 13:49:30.009456 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:30.009364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:30.110145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:30.110103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:30.186090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:30.186058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:30.516110 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:30.516074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:30.870989 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:30.870897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:32.930523 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:32.930494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:33.606327 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:33.606289    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:33.795043 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:33.795009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:34.523525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:34.523488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:35.858063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:35.858030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:36.869512 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:36.869472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:38.013942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:38.013907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:38.951294 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:38.951259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"]
Sep 18 13:49:38.955058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:38.955032    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:38.958815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:38.958793    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-eaff22-serving-cert\""
Sep 18 13:49:38.973683 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:38.973660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"]
Sep 18 13:49:39.004178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.004151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:39.079708 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.079679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.079708 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.079709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.080150 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.079753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dfef669-5459-4116-9618-b6a92e8e7e54-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.080150 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.079855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sst96\" (UniqueName: \"kubernetes.io/projected/4dfef669-5459-4116-9618-b6a92e8e7e54-kube-api-access-sst96\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.123086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.123052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:39.181046 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.181005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dfef669-5459-4116-9618-b6a92e8e7e54-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.181221 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.181072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sst96\" (UniqueName: \"kubernetes.io/projected/4dfef669-5459-4116-9618-b6a92e8e7e54-kube-api-access-sst96\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.181221 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.181155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.181221 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.181184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.181408 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:49:39.181279    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-serving-cert: secret "maas-api-e2e-ipp-cleanup-eaff22-serving-cert" not found
Sep 18 13:49:39.181408 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:49:39.181343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls podName:4dfef669-5459-4116-9618-b6a92e8e7e54 nodeName:}" failed. No retries permitted until 2026-09-18 13:49:39.681323698 +0000 UTC m=+2097.050583072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" (UID: "4dfef669-5459-4116-9618-b6a92e8e7e54") : secret "maas-api-e2e-ipp-cleanup-eaff22-serving-cert" not found
Sep 18 13:49:39.181646 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.181628    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dfef669-5459-4116-9618-b6a92e8e7e54-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.183570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.183549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.199579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.199556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sst96\" (UniqueName: \"kubernetes.io/projected/4dfef669-5459-4116-9618-b6a92e8e7e54-kube-api-access-sst96\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.606452 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.606417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:39.686378 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.686341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.688919 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.688895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:39.718248 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.718215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:39.821277 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.821250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:39.865647 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:39.865581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:40.171929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:40.171902    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"]
Sep 18 13:49:40.173760 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:49:40.173729    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dfef669_5459_4116_9618_b6a92e8e7e54.slice/crio-6f2113aef38f6a102e7df431a681529ba45a54d54091c6c2e1c9511490bd9c90 WatchSource:0}: Error finding container 6f2113aef38f6a102e7df431a681529ba45a54d54091c6c2e1c9511490bd9c90: Status 404 returned error can't find the container with id 6f2113aef38f6a102e7df431a681529ba45a54d54091c6c2e1c9511490bd9c90
Sep 18 13:49:40.428575 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:40.428497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" event={"ID":"4dfef669-5459-4116-9618-b6a92e8e7e54","Type":"ContainerStarted","Data":"6f2113aef38f6a102e7df431a681529ba45a54d54091c6c2e1c9511490bd9c90"}
Sep 18 13:49:41.435678 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:41.435641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" event={"ID":"4dfef669-5459-4116-9618-b6a92e8e7e54","Type":"ContainerStarted","Data":"10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c"}
Sep 18 13:49:41.436058 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:41.435778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:41.471076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:41.471021    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" podStartSLOduration=2.864189614 podStartE2EDuration="3.47100436s" totalImagesPullingTime="606.814746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:49:41.46901752 +0000 UTC m=+2098.838276914" watchObservedRunningTime="2026-09-18 13:49:41.47100436 +0000 UTC m=+2098.840263743"
Sep 18 13:49:43.324783 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:43.324743    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:49:43.327748 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:43.327728    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:49:47.447318 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:47.447288    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:49:54.555515 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:54.555484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:54.645007 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:49:54.644981    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:01.944153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:01.944116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:03.012369 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:03.012335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:03.633204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:03.633156    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:04.018824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:04.018787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:05.450338 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:05.450300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:06.371691 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:06.371649    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:07.233833 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:07.233798    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:08.039425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:08.039386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:08.214177 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:08.214141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:09.214968 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:09.214928    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:10.198001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:10.197960    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:15.167517 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:15.167478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:15.959738 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:15.959708    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"]
Sep 18 13:50:15.959934 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:15.959914    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" podUID="4dfef669-5459-4116-9618-b6a92e8e7e54" containerName="maas-api" containerID="cri-o://10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c" gracePeriod=30
Sep 18 13:50:16.002022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.001991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:16.136735 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.136667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:16.216676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.216625    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:50:16.232120 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.232100    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dfef669-5459-4116-9618-b6a92e8e7e54-openshift-service-ca\") pod \"4dfef669-5459-4116-9618-b6a92e8e7e54\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") "
Sep 18 13:50:16.232246 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.232151    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sst96\" (UniqueName: \"kubernetes.io/projected/4dfef669-5459-4116-9618-b6a92e8e7e54-kube-api-access-sst96\") pod \"4dfef669-5459-4116-9618-b6a92e8e7e54\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") "
Sep 18 13:50:16.232246 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.232179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-metrics-certs\") pod \"4dfef669-5459-4116-9618-b6a92e8e7e54\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") "
Sep 18 13:50:16.232246 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.232225    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls\") pod \"4dfef669-5459-4116-9618-b6a92e8e7e54\" (UID: \"4dfef669-5459-4116-9618-b6a92e8e7e54\") "
Sep 18 13:50:16.232479 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.232452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dfef669-5459-4116-9618-b6a92e8e7e54-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4dfef669-5459-4116-9618-b6a92e8e7e54" (UID: "4dfef669-5459-4116-9618-b6a92e8e7e54"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:50:16.232570 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.232553    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dfef669-5459-4116-9618-b6a92e8e7e54-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:16.234351 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.234320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dfef669-5459-4116-9618-b6a92e8e7e54-kube-api-access-sst96" (OuterVolumeSpecName: "kube-api-access-sst96") pod "4dfef669-5459-4116-9618-b6a92e8e7e54" (UID: "4dfef669-5459-4116-9618-b6a92e8e7e54"). InnerVolumeSpecName "kube-api-access-sst96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:50:16.234470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.234371    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4dfef669-5459-4116-9618-b6a92e8e7e54" (UID: "4dfef669-5459-4116-9618-b6a92e8e7e54"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:50:16.234470 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.234400    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4dfef669-5459-4116-9618-b6a92e8e7e54" (UID: "4dfef669-5459-4116-9618-b6a92e8e7e54"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:50:16.283125 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.283093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:16.333459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.333428    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sst96\" (UniqueName: \"kubernetes.io/projected/4dfef669-5459-4116-9618-b6a92e8e7e54-kube-api-access-sst96\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:16.333459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.333455    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:16.333459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.333463    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dfef669-5459-4116-9618-b6a92e8e7e54-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:16.393405 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.393371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:16.642554 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.642524    2564 generic.go:356] "Generic (PLEG): container finished" podID="4dfef669-5459-4116-9618-b6a92e8e7e54" containerID="10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c" exitCode=0
Sep 18 13:50:16.642730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.642571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" event={"ID":"4dfef669-5459-4116-9618-b6a92e8e7e54","Type":"ContainerDied","Data":"10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c"}
Sep 18 13:50:16.642730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.642582    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"
Sep 18 13:50:16.642730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.642647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s" event={"ID":"4dfef669-5459-4116-9618-b6a92e8e7e54","Type":"ContainerDied","Data":"6f2113aef38f6a102e7df431a681529ba45a54d54091c6c2e1c9511490bd9c90"}
Sep 18 13:50:16.642730 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.642677    2564 scope.go:117] "RemoveContainer" containerID="10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c"
Sep 18 13:50:16.652425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.652408    2564 scope.go:117] "RemoveContainer" containerID="10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c"
Sep 18 13:50:16.652706 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:50:16.652683    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c\": container with ID starting with 10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c not found: ID does not exist" containerID="10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c"
Sep 18 13:50:16.652774 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.652718    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c"} err="failed to get container status \"10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c\": rpc error: code = NotFound desc = could not find container \"10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c\": container with ID starting with 10d6ec995d533491c3a78fe2085fa9fcd9be91125ed28b88ca75dec6b3c4cd9c not found: ID does not exist"
Sep 18 13:50:16.672035 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.672012    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"]
Sep 18 13:50:16.676828 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.676806    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-eaff22-598b788f44-8r28s"]
Sep 18 13:50:16.682233 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.682213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:16.780448 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:16.780423    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:17.215577 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:17.215547    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dfef669-5459-4116-9618-b6a92e8e7e54" path="/var/lib/kubelet/pods/4dfef669-5459-4116-9618-b6a92e8e7e54/volumes"
Sep 18 13:50:17.765996 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:17.765959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:18.547447 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:18.547397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:19.394259 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:19.394230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:20.414090 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:20.414059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:23.549694 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:23.549656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:23.646552 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:23.646514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:23.850812 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:23.850727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:27.964132 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:27.964095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:28.786424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:28.786386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:29.663812 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:29.663777    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:30.382266 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:30.382226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:31.449009 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:31.448971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:32.757906 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:32.757874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:40.887156 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:40.887071    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:43.321372 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.321335    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"]
Sep 18 13:50:43.321799 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.321569    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" podUID="5decd604-936d-4afd-b76f-b366def574b1" containerName="maas-api" containerID="cri-o://ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2" gracePeriod=30
Sep 18 13:50:43.364756 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.364728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:43.462743 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.462704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:43.555859 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.555814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:43.584912 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.584860    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:50:43.643473 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.643437    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:43.692873 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.692849    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8c77\" (UniqueName: \"kubernetes.io/projected/5decd604-936d-4afd-b76f-b366def574b1-kube-api-access-p8c77\") pod \"5decd604-936d-4afd-b76f-b366def574b1\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") "
Sep 18 13:50:43.693016 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.692890    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5decd604-936d-4afd-b76f-b366def574b1-openshift-service-ca\") pod \"5decd604-936d-4afd-b76f-b366def574b1\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") "
Sep 18 13:50:43.693016 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.692962    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-metrics-certs\") pod \"5decd604-936d-4afd-b76f-b366def574b1\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") "
Sep 18 13:50:43.693124 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.693080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls\") pod \"5decd604-936d-4afd-b76f-b366def574b1\" (UID: \"5decd604-936d-4afd-b76f-b366def574b1\") "
Sep 18 13:50:43.693384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.693351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5decd604-936d-4afd-b76f-b366def574b1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5decd604-936d-4afd-b76f-b366def574b1" (UID: "5decd604-936d-4afd-b76f-b366def574b1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:50:43.695292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.695177    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5decd604-936d-4afd-b76f-b366def574b1" (UID: "5decd604-936d-4afd-b76f-b366def574b1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:50:43.695292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.695205    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5decd604-936d-4afd-b76f-b366def574b1-kube-api-access-p8c77" (OuterVolumeSpecName: "kube-api-access-p8c77") pod "5decd604-936d-4afd-b76f-b366def574b1" (UID: "5decd604-936d-4afd-b76f-b366def574b1"). InnerVolumeSpecName "kube-api-access-p8c77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:50:43.695292 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.695210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5decd604-936d-4afd-b76f-b366def574b1" (UID: "5decd604-936d-4afd-b76f-b366def574b1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:50:43.794345 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.794310    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:43.794345 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.794338    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8c77\" (UniqueName: \"kubernetes.io/projected/5decd604-936d-4afd-b76f-b366def574b1-kube-api-access-p8c77\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:43.794345 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.794348    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5decd604-936d-4afd-b76f-b366def574b1-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:43.794567 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.794357    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5decd604-936d-4afd-b76f-b366def574b1-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:50:43.806398 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.806372    2564 generic.go:356] "Generic (PLEG): container finished" podID="5decd604-936d-4afd-b76f-b366def574b1" containerID="ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2" exitCode=0
Sep 18 13:50:43.806529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.806416    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"
Sep 18 13:50:43.806529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.806462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" event={"ID":"5decd604-936d-4afd-b76f-b366def574b1","Type":"ContainerDied","Data":"ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2"}
Sep 18 13:50:43.806529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.806513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx" event={"ID":"5decd604-936d-4afd-b76f-b366def574b1","Type":"ContainerDied","Data":"f64b05c0f23f31977d340b8c41bd058e109426e183d0a9262acf07ed36be8ed9"}
Sep 18 13:50:43.806636 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.806541    2564 scope.go:117] "RemoveContainer" containerID="ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2"
Sep 18 13:50:43.816795 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.816778    2564 scope.go:117] "RemoveContainer" containerID="ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2"
Sep 18 13:50:43.817048 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:50:43.817031    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2\": container with ID starting with ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2 not found: ID does not exist" containerID="ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2"
Sep 18 13:50:43.817093 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.817058    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2"} err="failed to get container status \"ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2\": rpc error: code = NotFound desc = could not find container \"ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2\": container with ID starting with ee0a36636fbafb9b2ba8b5a267ee524694d4368019e578c745f8830d478fc6d2 not found: ID does not exist"
Sep 18 13:50:43.832578 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.832556    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"]
Sep 18 13:50:43.838607 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:43.838559    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2dd8de-555446d9b6-n75hx"]
Sep 18 13:50:44.049073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:44.049031    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:44.154407 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:44.154284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:44.959929 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:44.959890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:45.215535 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:45.215460    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5decd604-936d-4afd-b76f-b366def574b1" path="/var/lib/kubelet/pods/5decd604-936d-4afd-b76f-b366def574b1/volumes"
Sep 18 13:50:45.960306 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:45.960276    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:46.926140 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:46.926110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:49.072845 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:49.072811    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:49.170932 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:50:49.170899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:17.313027 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:17.312961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:17.781355 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:17.781322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:23.660982 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:23.660947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:23.745315 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:23.745282    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:24.003491 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:24.003459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:24.601767 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:24.601725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:25.569102 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:25.569067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:26.342830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:26.342786    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:27.066955 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:27.066911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:27.941449 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:27.941417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:34.912719 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:34.912687    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"]
Sep 18 13:51:34.913141 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:34.912918    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" podUID="081ac2f5-5c50-49e0-9538-5a3f8becd42f" containerName="maas-api" containerID="cri-o://90b42c491c41bc3bd19e958aadf8930b73b88d3c2ff3152068dec82cac460ea0" gracePeriod=30
Sep 18 13:51:34.946847 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:34.946813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:35.040457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.040427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:35.113615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.113583    2564 generic.go:356] "Generic (PLEG): container finished" podID="081ac2f5-5c50-49e0-9538-5a3f8becd42f" containerID="90b42c491c41bc3bd19e958aadf8930b73b88d3c2ff3152068dec82cac460ea0" exitCode=0
Sep 18 13:51:35.113764 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.113616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" event={"ID":"081ac2f5-5c50-49e0-9538-5a3f8becd42f","Type":"ContainerDied","Data":"90b42c491c41bc3bd19e958aadf8930b73b88d3c2ff3152068dec82cac460ea0"}
Sep 18 13:51:35.126183 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.126144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:35.163301 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.163245    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:51:35.222284 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.222251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:35.266830 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.266801    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-metrics-certs\") pod \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") "
Sep 18 13:51:35.266991 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.266916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fsqn\" (UniqueName: \"kubernetes.io/projected/081ac2f5-5c50-49e0-9538-5a3f8becd42f-kube-api-access-2fsqn\") pod \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") "
Sep 18 13:51:35.267063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.266989    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/081ac2f5-5c50-49e0-9538-5a3f8becd42f-openshift-service-ca\") pod \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") "
Sep 18 13:51:35.267063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.267031    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls\") pod \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\" (UID: \"081ac2f5-5c50-49e0-9538-5a3f8becd42f\") "
Sep 18 13:51:35.267370 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.267348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081ac2f5-5c50-49e0-9538-5a3f8becd42f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "081ac2f5-5c50-49e0-9538-5a3f8becd42f" (UID: "081ac2f5-5c50-49e0-9538-5a3f8becd42f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:51:35.269051 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.269025    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081ac2f5-5c50-49e0-9538-5a3f8becd42f-kube-api-access-2fsqn" (OuterVolumeSpecName: "kube-api-access-2fsqn") pod "081ac2f5-5c50-49e0-9538-5a3f8becd42f" (UID: "081ac2f5-5c50-49e0-9538-5a3f8becd42f"). InnerVolumeSpecName "kube-api-access-2fsqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:51:35.269146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.269085    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "081ac2f5-5c50-49e0-9538-5a3f8becd42f" (UID: "081ac2f5-5c50-49e0-9538-5a3f8becd42f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:51:35.269146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.269108    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "081ac2f5-5c50-49e0-9538-5a3f8becd42f" (UID: "081ac2f5-5c50-49e0-9538-5a3f8becd42f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:51:35.301790 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.301758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:35.368274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.368240    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:35.368274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.368271    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/081ac2f5-5c50-49e0-9538-5a3f8becd42f-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:35.368274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.368280    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fsqn\" (UniqueName: \"kubernetes.io/projected/081ac2f5-5c50-49e0-9538-5a3f8becd42f-kube-api-access-2fsqn\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:35.368274 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.368291    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/081ac2f5-5c50-49e0-9538-5a3f8becd42f-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:35.734803 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.734768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:35.933549 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:35.933516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:36.121088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:36.121060    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"
Sep 18 13:51:36.121088 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:36.121069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm" event={"ID":"081ac2f5-5c50-49e0-9538-5a3f8becd42f","Type":"ContainerDied","Data":"da78460c6e9776855ad2de5247c697cbfcd47371980ce0347300019416d60a37"}
Sep 18 13:51:36.121380 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:36.121139    2564 scope.go:117] "RemoveContainer" containerID="90b42c491c41bc3bd19e958aadf8930b73b88d3c2ff3152068dec82cac460ea0"
Sep 18 13:51:36.159549 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:36.159523    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"]
Sep 18 13:51:36.169697 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:36.169675    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f629bd-c8895cb4f-fmhjm"]
Sep 18 13:51:36.740946 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:36.740913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:37.215964 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:37.215881    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="081ac2f5-5c50-49e0-9538-5a3f8becd42f" path="/var/lib/kubelet/pods/081ac2f5-5c50-49e0-9538-5a3f8becd42f/volumes"
Sep 18 13:51:37.637061 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:37.637024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:42.491724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:42.491681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:42.598146 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:42.598110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:42.797663 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:42.797577    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:43.939017 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:43.938927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:44.864185 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:44.864137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:45.718057 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:45.718027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:53.818317 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:53.818282    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"]
Sep 18 13:51:53.818800 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:53.818580    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" podUID="d4366d31-8522-488d-8ca7-15394254a8db" containerName="maas-api" containerID="cri-o://604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a" gracePeriod=30
Sep 18 13:51:53.869827 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:53.869789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:53.977114 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:53.977035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:54.077738 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.077672    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:51:54.079021 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.078995    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:54.131153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.131077    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4366d31-8522-488d-8ca7-15394254a8db-openshift-service-ca\") pod \"d4366d31-8522-488d-8ca7-15394254a8db\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") "
Sep 18 13:51:54.131153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.131141    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hddz\" (UniqueName: \"kubernetes.io/projected/d4366d31-8522-488d-8ca7-15394254a8db-kube-api-access-9hddz\") pod \"d4366d31-8522-488d-8ca7-15394254a8db\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") "
Sep 18 13:51:54.131894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.131162    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls\") pod \"d4366d31-8522-488d-8ca7-15394254a8db\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") "
Sep 18 13:51:54.131894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.131242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-metrics-certs\") pod \"d4366d31-8522-488d-8ca7-15394254a8db\" (UID: \"d4366d31-8522-488d-8ca7-15394254a8db\") "
Sep 18 13:51:54.131894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.131444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4366d31-8522-488d-8ca7-15394254a8db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d4366d31-8522-488d-8ca7-15394254a8db" (UID: "d4366d31-8522-488d-8ca7-15394254a8db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:51:54.131894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.131574    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4366d31-8522-488d-8ca7-15394254a8db-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:54.133981 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.133954    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d4366d31-8522-488d-8ca7-15394254a8db" (UID: "d4366d31-8522-488d-8ca7-15394254a8db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:51:54.134108 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.134057    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d4366d31-8522-488d-8ca7-15394254a8db" (UID: "d4366d31-8522-488d-8ca7-15394254a8db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:51:54.134472 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.134452    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4366d31-8522-488d-8ca7-15394254a8db-kube-api-access-9hddz" (OuterVolumeSpecName: "kube-api-access-9hddz") pod "d4366d31-8522-488d-8ca7-15394254a8db" (UID: "d4366d31-8522-488d-8ca7-15394254a8db"). InnerVolumeSpecName "kube-api-access-9hddz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:51:54.232589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.232555    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hddz\" (UniqueName: \"kubernetes.io/projected/d4366d31-8522-488d-8ca7-15394254a8db-kube-api-access-9hddz\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:54.232589 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.232589    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:54.232824 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.232603    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4366d31-8522-488d-8ca7-15394254a8db-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:51:54.236417 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.236392    2564 generic.go:356] "Generic (PLEG): container finished" podID="d4366d31-8522-488d-8ca7-15394254a8db" containerID="604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a" exitCode=0
Sep 18 13:51:54.236568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.236424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" event={"ID":"d4366d31-8522-488d-8ca7-15394254a8db","Type":"ContainerDied","Data":"604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a"}
Sep 18 13:51:54.236568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.236440    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"
Sep 18 13:51:54.236568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.236464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q" event={"ID":"d4366d31-8522-488d-8ca7-15394254a8db","Type":"ContainerDied","Data":"966beabaf2e13ee167ceb0410cfdcc647bc70a7e56fca21a1003a49816ef86d0"}
Sep 18 13:51:54.236568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.236485    2564 scope.go:117] "RemoveContainer" containerID="604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a"
Sep 18 13:51:54.246019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.246000    2564 scope.go:117] "RemoveContainer" containerID="604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a"
Sep 18 13:51:54.246307 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:51:54.246287    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a\": container with ID starting with 604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a not found: ID does not exist" containerID="604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a"
Sep 18 13:51:54.246390 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.246319    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a"} err="failed to get container status \"604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a\": rpc error: code = NotFound desc = could not find container \"604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a\": container with ID starting with 604c952dda95f367b35d312b5f323cbdfb93862880e5ef4aa28a54ad4939fd2a not found: ID does not exist"
Sep 18 13:51:54.296856 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.296825    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"]
Sep 18 13:51:54.305434 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.305409    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-537abe-5596f5c95-jln8q"]
Sep 18 13:51:54.315136 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.315105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:54.706419 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.706384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:54.803717 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:54.803676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:55.215101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:55.215070    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4366d31-8522-488d-8ca7-15394254a8db" path="/var/lib/kubelet/pods/d4366d31-8522-488d-8ca7-15394254a8db/volumes"
Sep 18 13:51:55.764125 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:51:55.764092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:01.190515 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:01.190484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:01.269797 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:01.269766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:01.478569 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:01.478485    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:02.833357 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:02.833314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:03.850296 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:03.850260    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:12.325187 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.325105    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"]
Sep 18 13:52:12.325709 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.325372    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz" podUID="cb51d577-1e3f-4d94-9150-23501898d0e7" containerName="maas-api" containerID="cri-o://bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510" gracePeriod=30
Sep 18 13:52:12.371603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.371569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:12.509942 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.509905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:12.571144 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.571123    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:52:12.677159 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.677070    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:12.704790 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.704745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4zvs\" (UniqueName: \"kubernetes.io/projected/cb51d577-1e3f-4d94-9150-23501898d0e7-kube-api-access-z4zvs\") pod \"cb51d577-1e3f-4d94-9150-23501898d0e7\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") "
Sep 18 13:52:12.704948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.704846    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb51d577-1e3f-4d94-9150-23501898d0e7-openshift-service-ca\") pod \"cb51d577-1e3f-4d94-9150-23501898d0e7\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") "
Sep 18 13:52:12.704948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.704925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-metrics-certs\") pod \"cb51d577-1e3f-4d94-9150-23501898d0e7\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") "
Sep 18 13:52:12.705481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.704985    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-maas-api-tls\") pod \"cb51d577-1e3f-4d94-9150-23501898d0e7\" (UID: \"cb51d577-1e3f-4d94-9150-23501898d0e7\") "
Sep 18 13:52:12.705481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.705136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb51d577-1e3f-4d94-9150-23501898d0e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb51d577-1e3f-4d94-9150-23501898d0e7" (UID: "cb51d577-1e3f-4d94-9150-23501898d0e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:52:12.705481 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.705335    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb51d577-1e3f-4d94-9150-23501898d0e7-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:12.707256 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.707229    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb51d577-1e3f-4d94-9150-23501898d0e7" (UID: "cb51d577-1e3f-4d94-9150-23501898d0e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:52:12.707371 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.707324    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cb51d577-1e3f-4d94-9150-23501898d0e7" (UID: "cb51d577-1e3f-4d94-9150-23501898d0e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:52:12.707457 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.707435    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb51d577-1e3f-4d94-9150-23501898d0e7-kube-api-access-z4zvs" (OuterVolumeSpecName: "kube-api-access-z4zvs") pod "cb51d577-1e3f-4d94-9150-23501898d0e7" (UID: "cb51d577-1e3f-4d94-9150-23501898d0e7"). InnerVolumeSpecName "kube-api-access-z4zvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:12.775202 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.775155    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:12.806258 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.806230    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4zvs\" (UniqueName: \"kubernetes.io/projected/cb51d577-1e3f-4d94-9150-23501898d0e7-kube-api-access-z4zvs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:12.806258 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.806255    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:12.806258 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.806264    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb51d577-1e3f-4d94-9150-23501898d0e7-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:12.852097 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:12.852050    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:13.180806 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.180748    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:13.272529 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.272500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:13.354781 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.354745    2564 generic.go:356] "Generic (PLEG): container finished" podID="cb51d577-1e3f-4d94-9150-23501898d0e7" containerID="bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510" exitCode=0
Sep 18 13:52:13.355271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.354789    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"
Sep 18 13:52:13.355271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.354824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz" event={"ID":"cb51d577-1e3f-4d94-9150-23501898d0e7","Type":"ContainerDied","Data":"bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510"}
Sep 18 13:52:13.355271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.354887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz" event={"ID":"cb51d577-1e3f-4d94-9150-23501898d0e7","Type":"ContainerDied","Data":"6f953cd1e13f33404aab03d6e185912e02a1e539206677c0066520c4f51ff247"}
Sep 18 13:52:13.355271 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.354925    2564 scope.go:117] "RemoveContainer" containerID="bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510"
Sep 18 13:52:13.364425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.364408    2564 scope.go:117] "RemoveContainer" containerID="bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510"
Sep 18 13:52:13.364693 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:52:13.364675    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510\": container with ID starting with bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510 not found: ID does not exist" containerID="bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510"
Sep 18 13:52:13.364739 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.364701    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510"} err="failed to get container status \"bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510\": rpc error: code = NotFound desc = could not find container \"bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510\": container with ID starting with bc2c85ca6adda69cefa01054ce258e5a3b04751ec2686361eac0c0c9dd798510 not found: ID does not exist"
Sep 18 13:52:13.380244 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.380186    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"]
Sep 18 13:52:13.382676 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:13.382653    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-c50e10-5485b6f7b5-4s7tz"]
Sep 18 13:52:15.214362 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:15.214335    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb51d577-1e3f-4d94-9150-23501898d0e7" path="/var/lib/kubelet/pods/cb51d577-1e3f-4d94-9150-23501898d0e7/volumes"
Sep 18 13:52:20.238347 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:20.238305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:20.338480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:20.338448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:20.534154 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:20.534116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:20.631332 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:20.631288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:23.316726 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.316691    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-phh8w"]
Sep 18 13:52:23.317186 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.316920    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65c4f9d49-phh8w" podUID="23eae345-7b4a-452a-96bc-84a64a437a54" containerName="manager" containerID="cri-o://85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c" gracePeriod=30
Sep 18 13:52:23.558698 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.558674    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:52:23.706410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.706313    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-metrics-certs\") pod \"23eae345-7b4a-452a-96bc-84a64a437a54\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") "
Sep 18 13:52:23.706410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.706381    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert\") pod \"23eae345-7b4a-452a-96bc-84a64a437a54\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") "
Sep 18 13:52:23.706410 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.706416    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcvvx\" (UniqueName: \"kubernetes.io/projected/23eae345-7b4a-452a-96bc-84a64a437a54-kube-api-access-qcvvx\") pod \"23eae345-7b4a-452a-96bc-84a64a437a54\" (UID: \"23eae345-7b4a-452a-96bc-84a64a437a54\") "
Sep 18 13:52:23.708534 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.708499    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23eae345-7b4a-452a-96bc-84a64a437a54" (UID: "23eae345-7b4a-452a-96bc-84a64a437a54"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:52:23.708645 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.708540    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23eae345-7b4a-452a-96bc-84a64a437a54" (UID: "23eae345-7b4a-452a-96bc-84a64a437a54"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:52:23.708645 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.708540    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23eae345-7b4a-452a-96bc-84a64a437a54-kube-api-access-qcvvx" (OuterVolumeSpecName: "kube-api-access-qcvvx") pod "23eae345-7b4a-452a-96bc-84a64a437a54" (UID: "23eae345-7b4a-452a-96bc-84a64a437a54"). InnerVolumeSpecName "kube-api-access-qcvvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:52:23.807568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.807533    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:23.807568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.807560    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23eae345-7b4a-452a-96bc-84a64a437a54-webhook-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:23.807568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:23.807573    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcvvx\" (UniqueName: \"kubernetes.io/projected/23eae345-7b4a-452a-96bc-84a64a437a54-kube-api-access-qcvvx\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:52:24.432050 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.432013    2564 generic.go:356] "Generic (PLEG): container finished" podID="23eae345-7b4a-452a-96bc-84a64a437a54" containerID="85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c" exitCode=0
Sep 18 13:52:24.432509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.432074    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-phh8w"
Sep 18 13:52:24.432509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.432104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-phh8w" event={"ID":"23eae345-7b4a-452a-96bc-84a64a437a54","Type":"ContainerDied","Data":"85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c"}
Sep 18 13:52:24.432509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.432181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-phh8w" event={"ID":"23eae345-7b4a-452a-96bc-84a64a437a54","Type":"ContainerDied","Data":"332e731b1c738176e34ebc426d1de334a169f0269283084a3c7f63990463db1c"}
Sep 18 13:52:24.432509 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.432225    2564 scope.go:117] "RemoveContainer" containerID="85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c"
Sep 18 13:52:24.443402 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.443333    2564 scope.go:117] "RemoveContainer" containerID="85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c"
Sep 18 13:52:24.444723 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:52:24.444689    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c\": container with ID starting with 85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c not found: ID does not exist" containerID="85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c"
Sep 18 13:52:24.444843 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.444733    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c"} err="failed to get container status \"85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c\": rpc error: code = NotFound desc = could not find container \"85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c\": container with ID starting with 85ff6e67d3073269a04318cd6e03272593b6fd34fc0a74613626bcb2ebc6c99c not found: ID does not exist"
Sep 18 13:52:24.456425 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.456403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-phh8w"]
Sep 18 13:52:24.460217 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:24.460181    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-phh8w"]
Sep 18 13:52:25.216647 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:52:25.216614    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23eae345-7b4a-452a-96bc-84a64a437a54" path="/var/lib/kubelet/pods/23eae345-7b4a-452a-96bc-84a64a437a54/volumes"
Sep 18 13:53:25.278422 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278386    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65c4f9d49-nkh6d"]
Sep 18 13:53:25.278825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278794    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23eae345-7b4a-452a-96bc-84a64a437a54" containerName="manager"
Sep 18 13:53:25.278825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278806    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="23eae345-7b4a-452a-96bc-84a64a437a54" containerName="manager"
Sep 18 13:53:25.278825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278815    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081ac2f5-5c50-49e0-9538-5a3f8becd42f" containerName="maas-api"
Sep 18 13:53:25.278825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278821    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="081ac2f5-5c50-49e0-9538-5a3f8becd42f" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278829    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5decd604-936d-4afd-b76f-b366def574b1" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278838    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5decd604-936d-4afd-b76f-b366def574b1" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278852    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb51d577-1e3f-4d94-9150-23501898d0e7" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278857    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb51d577-1e3f-4d94-9150-23501898d0e7" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278865    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4366d31-8522-488d-8ca7-15394254a8db" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278870    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4366d31-8522-488d-8ca7-15394254a8db" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278876    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dfef669-5459-4116-9618-b6a92e8e7e54" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278881    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dfef669-5459-4116-9618-b6a92e8e7e54" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278951    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dfef669-5459-4116-9618-b6a92e8e7e54" containerName="maas-api"
Sep 18 13:53:25.278959 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278960    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4366d31-8522-488d-8ca7-15394254a8db" containerName="maas-api"
Sep 18 13:53:25.279282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278967    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5decd604-936d-4afd-b76f-b366def574b1" containerName="maas-api"
Sep 18 13:53:25.279282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278973    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="23eae345-7b4a-452a-96bc-84a64a437a54" containerName="manager"
Sep 18 13:53:25.279282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278980    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="081ac2f5-5c50-49e0-9538-5a3f8becd42f" containerName="maas-api"
Sep 18 13:53:25.279282 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.278989    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb51d577-1e3f-4d94-9150-23501898d0e7" containerName="maas-api"
Sep 18 13:53:25.282135 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.282118    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.286007 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.285983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6grfs\""
Sep 18 13:53:25.286007 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.285998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 13:53:25.286212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.286022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 13:53:25.286212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.286024    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 13:53:25.294188 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.294166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-nkh6d"]
Sep 18 13:53:25.357633 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.357601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-metrics-certs\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.357769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.357659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw557\" (UniqueName: \"kubernetes.io/projected/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-kube-api-access-sw557\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.357769 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.357758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-webhook-cert\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.458599 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.458567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-webhook-cert\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.458760 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.458637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-metrics-certs\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.458760 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.458688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw557\" (UniqueName: \"kubernetes.io/projected/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-kube-api-access-sw557\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.461202 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.461169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-webhook-cert\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.461293 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.461169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-metrics-certs\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.467615 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.467592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw557\" (UniqueName: \"kubernetes.io/projected/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-kube-api-access-sw557\") pod \"maas-controller-65c4f9d49-nkh6d\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") " pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.592360 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.592281    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:25.871783 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.871757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-nkh6d"]
Sep 18 13:53:25.872328 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:53:25.872303    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b60873_f27d_4ca1_a8e0_bf0c6192dcfc.slice/crio-ca474a7aabae151f56c39303ede481b73480fdf9519d11370a7541c5e09f6d36 WatchSource:0}: Error finding container ca474a7aabae151f56c39303ede481b73480fdf9519d11370a7541c5e09f6d36: Status 404 returned error can't find the container with id ca474a7aabae151f56c39303ede481b73480fdf9519d11370a7541c5e09f6d36
Sep 18 13:53:25.873605 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:25.873586    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:53:26.783350 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:26.783317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-nkh6d" event={"ID":"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc","Type":"ContainerStarted","Data":"cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea"}
Sep 18 13:53:26.783724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:26.783366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-nkh6d" event={"ID":"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc","Type":"ContainerStarted","Data":"ca474a7aabae151f56c39303ede481b73480fdf9519d11370a7541c5e09f6d36"}
Sep 18 13:53:26.783724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:26.783510    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:26.806723 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:26.806675    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65c4f9d49-nkh6d" podStartSLOduration=1.048488424 podStartE2EDuration="1.806659075s" totalImagesPullingTime="758.170651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:26.802948539 +0000 UTC m=+2324.172207921" watchObservedRunningTime="2026-09-18 13:53:26.806659075 +0000 UTC m=+2324.175918457"
Sep 18 13:53:37.792203 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:37.792109    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:49.145475 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.145417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:49.223502 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.223474    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-nkh6d"]
Sep 18 13:53:49.223674 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.223648    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65c4f9d49-nkh6d" podUID="e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" containerName="manager" containerID="cri-o://cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea" gracePeriod=30
Sep 18 13:53:49.473867 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.473838    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:49.574480 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.574450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-metrics-certs\") pod \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") "
Sep 18 13:53:49.574634 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.574503    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-webhook-cert\") pod \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") "
Sep 18 13:53:49.574634 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.574550    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw557\" (UniqueName: \"kubernetes.io/projected/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-kube-api-access-sw557\") pod \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\" (UID: \"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc\") "
Sep 18 13:53:49.576510 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.576478    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" (UID: "e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:53:49.576641 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.576542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" (UID: "e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:53:49.576641 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.576541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-kube-api-access-sw557" (OuterVolumeSpecName: "kube-api-access-sw557") pod "e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" (UID: "e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc"). InnerVolumeSpecName "kube-api-access-sw557". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:53:49.675686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.675661    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:53:49.675686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.675682    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-webhook-cert\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:53:49.675849 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.675692    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw557\" (UniqueName: \"kubernetes.io/projected/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc-kube-api-access-sw557\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:53:49.926168 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.926132    2564 generic.go:356] "Generic (PLEG): container finished" podID="e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" containerID="cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea" exitCode=0
Sep 18 13:53:49.926356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.926188    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-nkh6d"
Sep 18 13:53:49.926356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.926220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-nkh6d" event={"ID":"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc","Type":"ContainerDied","Data":"cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea"}
Sep 18 13:53:49.926356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.926268    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-nkh6d" event={"ID":"e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc","Type":"ContainerDied","Data":"ca474a7aabae151f56c39303ede481b73480fdf9519d11370a7541c5e09f6d36"}
Sep 18 13:53:49.926356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.926291    2564 scope.go:117] "RemoveContainer" containerID="cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea"
Sep 18 13:53:49.935696 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.935678    2564 scope.go:117] "RemoveContainer" containerID="cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea"
Sep 18 13:53:49.935936 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:53:49.935917    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea\": container with ID starting with cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea not found: ID does not exist" containerID="cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea"
Sep 18 13:53:49.936001 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.935949    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea"} err="failed to get container status \"cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea\": rpc error: code = NotFound desc = could not find container \"cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea\": container with ID starting with cc2dc453373d4841f7b54731515c16ca61ede608351b37649b2ede705efcbdea not found: ID does not exist"
Sep 18 13:53:49.953472 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.953063    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-nkh6d"]
Sep 18 13:53:49.958167 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:49.958144    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-nkh6d"]
Sep 18 13:53:50.645912 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.645876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:50.759682 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.759650    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65c4f9d49-s5k62"]
Sep 18 13:53:50.760073 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.760061    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" containerName="manager"
Sep 18 13:53:50.760128 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.760075    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" containerName="manager"
Sep 18 13:53:50.760165 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.760141    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" containerName="manager"
Sep 18 13:53:50.764532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.764515    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.768603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.768580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 13:53:50.768603 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.768591    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 13:53:50.768782 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.768599    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 13:53:50.768782 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.768599    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6grfs\""
Sep 18 13:53:50.775784 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.775760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-s5k62"]
Sep 18 13:53:50.886891 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.886849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-webhook-cert\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.887147 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.886935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-metrics-certs\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.887147 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.887014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mng\" (UniqueName: \"kubernetes.io/projected/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-kube-api-access-z6mng\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.988255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.988231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mng\" (UniqueName: \"kubernetes.io/projected/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-kube-api-access-z6mng\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.988400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.988296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-webhook-cert\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.988400 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.988355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-metrics-certs\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.990742 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.990722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-metrics-certs\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.990840 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.990761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-webhook-cert\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:50.996900 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:50.996882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mng\" (UniqueName: \"kubernetes.io/projected/ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f-kube-api-access-z6mng\") pod \"maas-controller-65c4f9d49-s5k62\" (UID: \"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f\") " pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:51.075760 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.075722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:51.215145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.215113    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc" path="/var/lib/kubelet/pods/e2b60873-f27d-4ca1-a8e0-bf0c6192dcfc/volumes"
Sep 18 13:53:51.349484 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.349459    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c4f9d49-s5k62"]
Sep 18 13:53:51.350799 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:53:51.350768    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3bfcc9_d1f6_459b_bcd9_a402fcf7b31f.slice/crio-4740a44776e7a2c6a40e0e98425f467abc7c7c06d61da5ea261c6343cee40bdc WatchSource:0}: Error finding container 4740a44776e7a2c6a40e0e98425f467abc7c7c06d61da5ea261c6343cee40bdc: Status 404 returned error can't find the container with id 4740a44776e7a2c6a40e0e98425f467abc7c7c06d61da5ea261c6343cee40bdc
Sep 18 13:53:51.940279 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.940246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-s5k62" event={"ID":"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f","Type":"ContainerStarted","Data":"9d4c006d0e8054e0c333c755808bfb25546ba3926aef7767e8508769e9c22e05"}
Sep 18 13:53:51.940673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.940295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c4f9d49-s5k62" event={"ID":"ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f","Type":"ContainerStarted","Data":"4740a44776e7a2c6a40e0e98425f467abc7c7c06d61da5ea261c6343cee40bdc"}
Sep 18 13:53:51.940673 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.940339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:53:51.966439 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:53:51.966360    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65c4f9d49-s5k62" podStartSLOduration=1.6197867110000002 podStartE2EDuration="1.96634717s" totalImagesPullingTime="346.560459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:51.964718246 +0000 UTC m=+2349.333977629" watchObservedRunningTime="2026-09-18 13:53:51.96634717 +0000 UTC m=+2349.335606543"
Sep 18 13:54:02.949528 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:54:02.949496    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65c4f9d49-s5k62"
Sep 18 13:54:40.956914 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:54:40.956873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:43.363811 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:54:43.363786    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:54:43.369943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:54:43.369921    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvg6n_23b9fa98-ef8e-4d95-a85d-7578c03c6e65/ovn-acl-logging/0.log"
Sep 18 13:55:29.410651 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:55:29.410613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:29.484631 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:55:29.484582    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:56:56.618459 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:56:56.618356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:07.052333 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:07.052293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:34.887925 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:34.887882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:40.606630 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:40.606592    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:40.666422 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:40.666393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:48.771579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:48.771545    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:49.582393 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:49.582363    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:49.980852 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:49.980756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:50.081779 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:57:50.081738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:12.087260 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.087162    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"]
Sep 18 13:58:12.091086 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.091063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.103957 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.103918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-openshift-service-ca\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.104145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.103993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjhw\" (UniqueName: \"kubernetes.io/projected/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-kube-api-access-vvjhw\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.104145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.104024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-metrics-certs\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.104145 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.104050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-maas-api-tls\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.109358 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.109335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"]
Sep 18 13:58:12.205356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.205316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjhw\" (UniqueName: \"kubernetes.io/projected/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-kube-api-access-vvjhw\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.205356 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.205352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-metrics-certs\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.205610 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.205370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-maas-api-tls\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.205610 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.205432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-openshift-service-ca\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.206039 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.206017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-openshift-service-ca\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.208078 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.208043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-maas-api-tls\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.208214 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.208048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-metrics-certs\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.213384 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.213364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjhw\" (UniqueName: \"kubernetes.io/projected/11a8cd14-d5ff-4057-8f11-b5b81255d3d5-kube-api-access-vvjhw\") pod \"maas-api-76cf6447c5-ljlp2\" (UID: \"11a8cd14-d5ff-4057-8f11-b5b81255d3d5\") " pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.401237 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.401147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:12.678727 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:12.678698    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"]
Sep 18 13:58:12.679515 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:58:12.679490    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a8cd14_d5ff_4057_8f11_b5b81255d3d5.slice/crio-d7bba815165aeb7798df27d19ac3a8fe49a8f06af242916494616d920a8c8700 WatchSource:0}: Error finding container d7bba815165aeb7798df27d19ac3a8fe49a8f06af242916494616d920a8c8700: Status 404 returned error can't find the container with id d7bba815165aeb7798df27d19ac3a8fe49a8f06af242916494616d920a8c8700
Sep 18 13:58:13.450666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:13.450582    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2" event={"ID":"11a8cd14-d5ff-4057-8f11-b5b81255d3d5","Type":"ContainerStarted","Data":"54126893f6999d367a5da7664df3e7bb5ce5f37b72e907c18dd429bae416d874"}
Sep 18 13:58:13.450666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:13.450638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2" event={"ID":"11a8cd14-d5ff-4057-8f11-b5b81255d3d5","Type":"ContainerStarted","Data":"d7bba815165aeb7798df27d19ac3a8fe49a8f06af242916494616d920a8c8700"}
Sep 18 13:58:13.450666 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:13.450660    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:13.469671 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:13.469623    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2" podStartSLOduration=1.072946809 podStartE2EDuration="1.469610108s" totalImagesPullingTime="396.663299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:13.468238795 +0000 UTC m=+2610.837498178" watchObservedRunningTime="2026-09-18 13:58:13.469610108 +0000 UTC m=+2610.838869520"
Sep 18 13:58:19.461401 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:19.461371    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-76cf6447c5-ljlp2"
Sep 18 13:58:27.660044 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:27.660005    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b89985555-ls92w"]
Sep 18 13:58:27.660424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:27.660231    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" podUID="672b955a-f3b1-44c3-8731-fb82f2e7662a" containerName="maas-api" containerID="cri-o://c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577" gracePeriod=30
Sep 18 13:58:28.228518 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.228472    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" podUID="672b955a-f3b1-44c3-8731-fb82f2e7662a" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.56:8443/health\": dial tcp 10.132.0.56:8443: connect: connection refused"
Sep 18 13:58:28.908460 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.908434    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:58:28.959386 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.959359    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs\") pod \"672b955a-f3b1-44c3-8731-fb82f2e7662a\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") "
Sep 18 13:58:28.959536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.959446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc9n5\" (UniqueName: \"kubernetes.io/projected/672b955a-f3b1-44c3-8731-fb82f2e7662a-kube-api-access-lc9n5\") pod \"672b955a-f3b1-44c3-8731-fb82f2e7662a\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") "
Sep 18 13:58:28.959536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.959487    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672b955a-f3b1-44c3-8731-fb82f2e7662a-openshift-service-ca\") pod \"672b955a-f3b1-44c3-8731-fb82f2e7662a\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") "
Sep 18 13:58:28.959536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.959516    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-maas-api-tls\") pod \"672b955a-f3b1-44c3-8731-fb82f2e7662a\" (UID: \"672b955a-f3b1-44c3-8731-fb82f2e7662a\") "
Sep 18 13:58:28.959795 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.959759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672b955a-f3b1-44c3-8731-fb82f2e7662a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "672b955a-f3b1-44c3-8731-fb82f2e7662a" (UID: "672b955a-f3b1-44c3-8731-fb82f2e7662a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:58:28.961564 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.961542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "672b955a-f3b1-44c3-8731-fb82f2e7662a" (UID: "672b955a-f3b1-44c3-8731-fb82f2e7662a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:58:28.961645 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.961575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "672b955a-f3b1-44c3-8731-fb82f2e7662a" (UID: "672b955a-f3b1-44c3-8731-fb82f2e7662a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:58:28.961687 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:28.961666    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672b955a-f3b1-44c3-8731-fb82f2e7662a-kube-api-access-lc9n5" (OuterVolumeSpecName: "kube-api-access-lc9n5") pod "672b955a-f3b1-44c3-8731-fb82f2e7662a" (UID: "672b955a-f3b1-44c3-8731-fb82f2e7662a"). InnerVolumeSpecName "kube-api-access-lc9n5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:29.061063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.060998    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-maas-api-tls\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:58:29.061063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.061022    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/672b955a-f3b1-44c3-8731-fb82f2e7662a-metrics-certs\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:58:29.061063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.061032    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc9n5\" (UniqueName: \"kubernetes.io/projected/672b955a-f3b1-44c3-8731-fb82f2e7662a-kube-api-access-lc9n5\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:58:29.061063 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.061040    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/672b955a-f3b1-44c3-8731-fb82f2e7662a-openshift-service-ca\") on node \"ip-10-0-136-225.ec2.internal\" DevicePath \"\""
Sep 18 13:58:29.542683 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.542654    2564 generic.go:356] "Generic (PLEG): container finished" podID="672b955a-f3b1-44c3-8731-fb82f2e7662a" containerID="c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577" exitCode=0
Sep 18 13:58:29.542842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.542702    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w"
Sep 18 13:58:29.542842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.542703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" event={"ID":"672b955a-f3b1-44c3-8731-fb82f2e7662a","Type":"ContainerDied","Data":"c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577"}
Sep 18 13:58:29.542842 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.542833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b89985555-ls92w" event={"ID":"672b955a-f3b1-44c3-8731-fb82f2e7662a","Type":"ContainerDied","Data":"9ec4e55b98f52a42d9907c54fa02b4343eaba0afc001938f4be35abdead1822f"}
Sep 18 13:58:29.542943 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.542870    2564 scope.go:117] "RemoveContainer" containerID="c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577"
Sep 18 13:58:29.552076 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.552056    2564 scope.go:117] "RemoveContainer" containerID="c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577"
Sep 18 13:58:29.552349 ip-10-0-136-225 kubenswrapper[2564]: E0918 13:58:29.552331    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577\": container with ID starting with c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577 not found: ID does not exist" containerID="c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577"
Sep 18 13:58:29.552408 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.552356    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577"} err="failed to get container status \"c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577\": rpc error: code = NotFound desc = could not find container \"c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577\": container with ID starting with c1c7ab08ee9e2dc312a503b5a503833181f51e29e16e07ae1e77e84ba1b81577 not found: ID does not exist"
Sep 18 13:58:29.564742 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.564711    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b89985555-ls92w"]
Sep 18 13:58:29.571956 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:29.571934    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b89985555-ls92w"]
Sep 18 13:58:31.215424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:31.215392    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672b955a-f3b1-44c3-8731-fb82f2e7662a" path="/var/lib/kubelet/pods/672b955a-f3b1-44c3-8731-fb82f2e7662a/volumes"
Sep 18 13:58:42.048074 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:42.048036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c8bc4f9f-5cs45_1cfd0207-bd58-44d2-ad03-d59a0448e6b6/authorino/0.log"
Sep 18 13:58:47.387744 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:47.387708    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4fdz6_910ba23e-5954-489f-8450-62963ac09a20/manager/0.log"
Sep 18 13:58:47.650588 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:47.650505    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65c4f9d49-s5k62_ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f/manager/0.log"
Sep 18 13:58:48.024066 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:48.024040    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854585bc8d-5ntpw_24ed932e-334f-4e36-ae94-61ea7287cb3f/copy-manifests/0.log"
Sep 18 13:58:48.036916 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:48.036891    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854585bc8d-5ntpw_24ed932e-334f-4e36-ae94-61ea7287cb3f/manager/0.log"
Sep 18 13:58:48.635888 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:48.635854    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-76cf6447c5-ljlp2_11a8cd14-d5ff-4057-8f11-b5b81255d3d5/maas-api/0.log"
Sep 18 13:58:49.115220 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:49.115150    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6rp6k_92637d72-0b9c-40b9-b8a3-4efc1dd9fbd8/postgres/0.log"
Sep 18 13:58:49.952853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:49.952817    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c8bc4f9f-5cs45_1cfd0207-bd58-44d2-ad03-d59a0448e6b6/authorino/0.log"
Sep 18 13:58:50.072856 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:50.072832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-w6btw_c74235a6-98f7-44f8-8f8d-05e0e8aa41e0/manager/0.log"
Sep 18 13:58:50.183763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:50.183715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ntqpd_ccc18df3-4777-4fbc-b634-01c256c0f7aa/manager/0.log"
Sep 18 13:58:50.300061 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:50.300038    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4p5ld_9affab7e-a8ff-473d-8be4-17188e4c4b06/kuadrant-console-plugin/0.log"
Sep 18 13:58:50.669930 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:50.669832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-xk2gb_cd252470-8421-4f92-a72b-c435cbfd22dc/manager/0.log"
Sep 18 13:58:51.386801 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:51.386769    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c5fc7c97f-kdwxp_8d49413f-965a-4887-b549-529f8e4bf0fb/kube-auth-proxy/0.log"
Sep 18 13:58:51.509626 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:51.509594    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/1.log"
Sep 18 13:58:51.635171 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:51.635145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-6tc8t_e1e4e976-1b11-4509-844e-e5ebc5455e82/payload-pre-processing/0.log"
Sep 18 13:58:51.779255 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:51.779221    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-hwhcb_578343e7-ca05-4da6-a096-84e93dc0601c/payload-processing/0.log"
Sep 18 13:58:51.896711 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:51.896685    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7d894bd-qg4wn_60f23438-f412-408c-9cc5-fcdc68f56508/router/0.log"
Sep 18 13:58:52.244337 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:52.244310    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lq4qc_6080f6fe-33e1-4457-a466-a9c01b4f5b6c/main/0.log"
Sep 18 13:58:52.580971 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:52.580882    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-m8wql_f0b68510-f353-4fbc-aecc-3c4c5d24dd54/main/0.log"
Sep 18 13:58:52.926917 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:52.926845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gjftl_03d1e62d-3ee2-423b-a37a-59c9ec816dbb/main/0.log"
Sep 18 13:58:58.335851 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.335821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:58.436852 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.436818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:58.502687 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.502661    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gnq97/must-gather-zcbfx"]
Sep 18 13:58:58.503054 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.503042    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672b955a-f3b1-44c3-8731-fb82f2e7662a" containerName="maas-api"
Sep 18 13:58:58.503098 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.503055    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="672b955a-f3b1-44c3-8731-fb82f2e7662a" containerName="maas-api"
Sep 18 13:58:58.503151 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.503141    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="672b955a-f3b1-44c3-8731-fb82f2e7662a" containerName="maas-api"
Sep 18 13:58:58.506385 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.506370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.509176 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.509159    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gnq97\"/\"kube-root-ca.crt\""
Sep 18 13:58:58.510280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.510260    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gnq97\"/\"default-dockercfg-jvgfk\""
Sep 18 13:58:58.510432 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.510304    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gnq97\"/\"openshift-service-ca.crt\""
Sep 18 13:58:58.513686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.513525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k54rx\" (UniqueName: \"kubernetes.io/projected/0425cda1-1854-4975-874d-7dfbfb159779-kube-api-access-k54rx\") pod \"must-gather-zcbfx\" (UID: \"0425cda1-1854-4975-874d-7dfbfb159779\") " pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.513686 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.513571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0425cda1-1854-4975-874d-7dfbfb159779-must-gather-output\") pod \"must-gather-zcbfx\" (UID: \"0425cda1-1854-4975-874d-7dfbfb159779\") " pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.515313 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.515292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gnq97/must-gather-zcbfx"]
Sep 18 13:58:58.614776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.614703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k54rx\" (UniqueName: \"kubernetes.io/projected/0425cda1-1854-4975-874d-7dfbfb159779-kube-api-access-k54rx\") pod \"must-gather-zcbfx\" (UID: \"0425cda1-1854-4975-874d-7dfbfb159779\") " pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.614776 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.614741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0425cda1-1854-4975-874d-7dfbfb159779-must-gather-output\") pod \"must-gather-zcbfx\" (UID: \"0425cda1-1854-4975-874d-7dfbfb159779\") " pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.615022 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.615008    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0425cda1-1854-4975-874d-7dfbfb159779-must-gather-output\") pod \"must-gather-zcbfx\" (UID: \"0425cda1-1854-4975-874d-7dfbfb159779\") " pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.629551 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.629526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k54rx\" (UniqueName: \"kubernetes.io/projected/0425cda1-1854-4975-874d-7dfbfb159779-kube-api-access-k54rx\") pod \"must-gather-zcbfx\" (UID: \"0425cda1-1854-4975-874d-7dfbfb159779\") " pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:58.816395 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:58.816361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gnq97/must-gather-zcbfx"
Sep 18 13:58:59.089656 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:59.089630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gnq97/must-gather-zcbfx"]
Sep 18 13:58:59.092463 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:58:59.092435    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0425cda1_1854_4975_874d_7dfbfb159779.slice/crio-36e2c8f1402dc547c61f5cf6e4a535ff1d9cce9539b0421082832baa25e523cb WatchSource:0}: Error finding container 36e2c8f1402dc547c61f5cf6e4a535ff1d9cce9539b0421082832baa25e523cb: Status 404 returned error can't find the container with id 36e2c8f1402dc547c61f5cf6e4a535ff1d9cce9539b0421082832baa25e523cb
Sep 18 13:58:59.094763 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:59.094746    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:58:59.727857 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:58:59.727811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gnq97/must-gather-zcbfx" event={"ID":"0425cda1-1854-4975-874d-7dfbfb159779","Type":"ContainerStarted","Data":"36e2c8f1402dc547c61f5cf6e4a535ff1d9cce9539b0421082832baa25e523cb"}
Sep 18 13:59:00.737365 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:00.737321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gnq97/must-gather-zcbfx" event={"ID":"0425cda1-1854-4975-874d-7dfbfb159779","Type":"ContainerStarted","Data":"84865117d5f377548597f009b7c57e68fb079aff1767d0852aa57c99bfcd80a4"}
Sep 18 13:59:00.737757 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:00.737379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gnq97/must-gather-zcbfx" event={"ID":"0425cda1-1854-4975-874d-7dfbfb159779","Type":"ContainerStarted","Data":"040c66f152b06cb7433858d2bfe819cbbe48e28adb197edd73952770f2389fca"}
Sep 18 13:59:00.754232 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:00.754160    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gnq97/must-gather-zcbfx" podStartSLOduration=1.961532694 podStartE2EDuration="2.754145374s" totalImagesPullingTime="792.61268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:00.752798024 +0000 UTC m=+2658.122057407" watchObservedRunningTime="2026-09-18 13:59:00.754145374 +0000 UTC m=+2658.123404757"
Sep 18 13:59:01.550532 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:01.550469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f855x_3b7d6d82-0974-4bde-83b4-1199b59617b4/global-pull-secret-syncer/0.log"
Sep 18 13:59:01.667948 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:01.667914    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log"
Sep 18 13:59:01.831568 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:01.831462    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-225.ec2.internal_f91b419163f2290a2d25c746cd1787c2/haproxy/0.log"
Sep 18 13:59:06.870212 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:06.867894    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c8bc4f9f-5cs45_1cfd0207-bd58-44d2-ad03-d59a0448e6b6/authorino/0.log"
Sep 18 13:59:06.916226 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:06.915625    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-w6btw_c74235a6-98f7-44f8-8f8d-05e0e8aa41e0/manager/0.log"
Sep 18 13:59:06.960845 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:06.960467    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ntqpd_ccc18df3-4777-4fbc-b634-01c256c0f7aa/manager/0.log"
Sep 18 13:59:07.000622 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:07.000594    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4p5ld_9affab7e-a8ff-473d-8be4-17188e4c4b06/kuadrant-console-plugin/0.log"
Sep 18 13:59:07.157926 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:07.157837    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-xk2gb_cd252470-8421-4f92-a72b-c435cbfd22dc/manager/0.log"
Sep 18 13:59:07.860280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:07.860242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:09.086635 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.086602    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-ff96c_29c13f40-6a90-4441-90c6-f818cad87524/monitoring-plugin/0.log"
Sep 18 13:59:09.287038 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.287005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtgfr_38140931-7de5-4bb9-baae-5c79e88653a6/node-exporter/0.log"
Sep 18 13:59:09.310169 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.310143    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtgfr_38140931-7de5-4bb9-baae-5c79e88653a6/kube-rbac-proxy/0.log"
Sep 18 13:59:09.335424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.335388    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtgfr_38140931-7de5-4bb9-baae-5c79e88653a6/init-textfile/0.log"
Sep 18 13:59:09.381054 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.380973    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-vrtn8_be387a3c-02cc-43be-9508-b7406e6aa2b1/kube-rbac-proxy-main/0.log"
Sep 18 13:59:09.407151 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.407125    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-vrtn8_be387a3c-02cc-43be-9508-b7406e6aa2b1/kube-rbac-proxy-self/0.log"
Sep 18 13:59:09.438019 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.437987    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-vrtn8_be387a3c-02cc-43be-9508-b7406e6aa2b1/openshift-state-metrics/0.log"
Sep 18 13:59:09.643262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.643169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4ctzp_241f85cb-a793-4570-8643-e5c916aafe2e/prometheus-operator/0.log"
Sep 18 13:59:09.665353 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.665322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4ctzp_241f85cb-a793-4570-8643-e5c916aafe2e/kube-rbac-proxy/0.log"
Sep 18 13:59:09.694514 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.694488    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-9lkxl_1882e4d7-a606-4172-bdce-43bc9f0ff879/prometheus-operator-admission-webhook/0.log"
Sep 18 13:59:09.834836 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.834801    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b54476bf6-ncwrw_830bc560-17ed-42fa-98d5-3d4447a360b9/thanos-query/0.log"
Sep 18 13:59:09.870368 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.870329    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b54476bf6-ncwrw_830bc560-17ed-42fa-98d5-3d4447a360b9/kube-rbac-proxy-web/0.log"
Sep 18 13:59:09.897664 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.897578    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b54476bf6-ncwrw_830bc560-17ed-42fa-98d5-3d4447a360b9/kube-rbac-proxy/0.log"
Sep 18 13:59:09.921915 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.921802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b54476bf6-ncwrw_830bc560-17ed-42fa-98d5-3d4447a360b9/prom-label-proxy/0.log"
Sep 18 13:59:09.945030 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.945000    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b54476bf6-ncwrw_830bc560-17ed-42fa-98d5-3d4447a360b9/kube-rbac-proxy-rules/0.log"
Sep 18 13:59:09.985885 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:09.985853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b54476bf6-ncwrw_830bc560-17ed-42fa-98d5-3d4447a360b9/kube-rbac-proxy-metrics/0.log"
Sep 18 13:59:11.151725 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.151684    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-m5p8x_72487d2c-ebc9-4257-8625-6aa9172da029/networking-console-plugin/0.log"
Sep 18 13:59:11.308531 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.308490    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"]
Sep 18 13:59:11.314831 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.314800    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.322853 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.322817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"]
Sep 18 13:59:11.364262 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.364226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-sys\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.364454 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.364388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-podres\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.364454 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.364443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-lib-modules\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.364579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.364504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-proc\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.364579 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.364554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z7k7\" (UniqueName: \"kubernetes.io/projected/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-kube-api-access-7z7k7\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.466129 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-sys\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.466424 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-sys\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.466601 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-podres\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.466695 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-lib-modules\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.466758 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-proc\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.466815 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z7k7\" (UniqueName: \"kubernetes.io/projected/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-kube-api-access-7z7k7\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.467184 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.466534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-podres\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.467335 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.467314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-lib-modules\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.467546 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.467505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-proc\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.475101 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.475074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z7k7\" (UniqueName: \"kubernetes.io/projected/4af7a5ef-5508-4c5f-baf2-d7319aaa6b51-kube-api-access-7z7k7\") pod \"perf-node-gather-daemonset-l76sn\" (UID: \"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51\") " pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.634626 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.634591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:11.931941 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:11.931806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"]
Sep 18 13:59:11.932962 ip-10-0-136-225 kubenswrapper[2564]: W0918 13:59:11.932937    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4af7a5ef_5508_4c5f_baf2_d7319aaa6b51.slice/crio-2f505ee38643e07c32ab1ffe76e54af131d8b47202a290e09ca552085e7da988 WatchSource:0}: Error finding container 2f505ee38643e07c32ab1ffe76e54af131d8b47202a290e09ca552085e7da988: Status 404 returned error can't find the container with id 2f505ee38643e07c32ab1ffe76e54af131d8b47202a290e09ca552085e7da988
Sep 18 13:59:12.387979 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:12.387954    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79c75b8ff7-wzrqd_880e77b8-91dc-468a-ab36-9ff0def575b8/console/0.log"
Sep 18 13:59:12.842077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:12.841996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn" event={"ID":"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51","Type":"ContainerStarted","Data":"b293de62677cbe1513f5d42138a7723079afe4612345b499ac5162e229fd08c4"}
Sep 18 13:59:12.842077 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:12.842061    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn" event={"ID":"4af7a5ef-5508-4c5f-baf2-d7319aaa6b51","Type":"ContainerStarted","Data":"2f505ee38643e07c32ab1ffe76e54af131d8b47202a290e09ca552085e7da988"}
Sep 18 13:59:12.845216 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:12.842874    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:12.861278 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:12.861205    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn" podStartSLOduration=1.861174198 podStartE2EDuration="1.861174198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:12.860002165 +0000 UTC m=+2670.229261547" watchObservedRunningTime="2026-09-18 13:59:12.861174198 +0000 UTC m=+2670.230433581"
Sep 18 13:59:14.444762 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:14.444735    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kq7gj_6f00e73f-7643-4db1-a96d-2bcf49f7237f/dns/0.log"
Sep 18 13:59:14.483003 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:14.482976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kq7gj_6f00e73f-7643-4db1-a96d-2bcf49f7237f/kube-rbac-proxy/0.log"
Sep 18 13:59:14.604724 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:14.604695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9f9fm_6b6e712a-ca30-4bab-aeb4-ec3506cd5af5/dns-node-resolver/0.log"
Sep 18 13:59:15.317902 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:15.317876    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s4jt7_813df9b5-73da-4639-9d03-550391e4313a/node-ca/0.log"
Sep 18 13:59:16.892798 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:16.892752    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c5fc7c97f-kdwxp_8d49413f-965a-4887-b549-529f8e4bf0fb/kube-auth-proxy/0.log"
Sep 18 13:59:16.924015 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:16.923979    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/0.log"
Sep 18 13:59:16.931419 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:16.931393    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/1.log"
Sep 18 13:59:16.974911 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:16.974884    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-6tc8t_e1e4e976-1b11-4509-844e-e5ebc5455e82/payload-pre-processing/0.log"
Sep 18 13:59:17.023536 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:17.023506    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-hwhcb_578343e7-ca05-4da6-a096-84e93dc0601c/payload-processing/0.log"
Sep 18 13:59:17.071782 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:17.071747    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7d894bd-qg4wn_60f23438-f412-408c-9cc5-fcdc68f56508/router/0.log"
Sep 18 13:59:18.048256 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:18.048226    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4smz_63858915-ce5e-476e-9d25-98a599268e93/serve-healthcheck-canary/0.log"
Sep 18 13:59:18.606243 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:18.606214    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-dfqt9_9cef1c8e-6903-45bb-b619-b5e9f81df344/insights-operator/0.log"
Sep 18 13:59:18.607712 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:18.607684    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-dfqt9_9cef1c8e-6903-45bb-b619-b5e9f81df344/insights-operator/1.log"
Sep 18 13:59:18.811894 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:18.811857    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ptnxt_f9be544d-af74-4615-98fb-adb0a7cdd9ec/kube-rbac-proxy/0.log"
Sep 18 13:59:18.849280 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:18.849249    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ptnxt_f9be544d-af74-4615-98fb-adb0a7cdd9ec/exporter/0.log"
Sep 18 13:59:18.885600 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:18.885515    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ptnxt_f9be544d-af74-4615-98fb-adb0a7cdd9ec/extractor/0.log"
Sep 18 13:59:19.866713 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:19.866686    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gnq97/perf-node-gather-daemonset-l76sn"
Sep 18 13:59:20.327525 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:20.327488    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:21.495127 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:21.495093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4fdz6_910ba23e-5954-489f-8450-62963ac09a20/manager/0.log"
Sep 18 13:59:21.835595 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:21.835562    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65c4f9d49-s5k62_ee3bfcc9-d1f6-459b-bcd9-a402fcf7b31f/manager/0.log"
Sep 18 13:59:21.989989 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:21.989956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854585bc8d-5ntpw_24ed932e-334f-4e36-ae94-61ea7287cb3f/manager/0.log"
Sep 18 13:59:22.017210 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.017154    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-854585bc8d-5ntpw_24ed932e-334f-4e36-ae94-61ea7287cb3f/copy-manifests/0.log"
Sep 18 13:59:22.613443 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.613415    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c5fc7c97f-kdwxp_8d49413f-965a-4887-b549-529f8e4bf0fb/kube-auth-proxy/0.log"
Sep 18 13:59:22.640486 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.640457    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/0.log"
Sep 18 13:59:22.648906 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.648885    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/1.log"
Sep 18 13:59:22.683825 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.683795    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-6tc8t_e1e4e976-1b11-4509-844e-e5ebc5455e82/payload-pre-processing/0.log"
Sep 18 13:59:22.726204 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.726175    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-hwhcb_578343e7-ca05-4da6-a096-84e93dc0601c/payload-processing/0.log"
Sep 18 13:59:22.745178 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:22.745083    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7d894bd-qg4wn_60f23438-f412-408c-9cc5-fcdc68f56508/router/0.log"
Sep 18 13:59:23.608371 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:23.608336    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-x48vc_58e9250a-613d-426d-ac05-7f50388659ad/openshift-lws-operator/0.log"
Sep 18 13:59:24.798170 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:24.798130    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c5fc7c97f-kdwxp_8d49413f-965a-4887-b549-529f8e4bf0fb/kube-auth-proxy/0.log"
Sep 18 13:59:24.823467 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:24.823439    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/0.log"
Sep 18 13:59:24.826759 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:24.826732    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-knht6_e5cf78c8-ba21-482b-be8f-4270e3da8a18/istio-proxy/1.log"
Sep 18 13:59:24.866604 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:24.866572    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-6tc8t_e1e4e976-1b11-4509-844e-e5ebc5455e82/payload-pre-processing/0.log"
Sep 18 13:59:24.908874 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:24.908530    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-hwhcb_578343e7-ca05-4da6-a096-84e93dc0601c/payload-processing/0.log"
Sep 18 13:59:24.934153 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:24.934128    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b7d894bd-qg4wn_60f23438-f412-408c-9cc5-fcdc68f56508/router/0.log"
Sep 18 13:59:25.398938 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:25.398906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:25.534513 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:25.534482    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d5kd_9bf5cb7e-2581-4102-b402-5c4c03bf77ba/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:30.439122 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:30.439094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7pzx_011f5db6-2d23-4056-91ce-209f7ba685d7/kube-multus-additional-cni-plugins/0.log"
Sep 18 13:59:30.473931 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:30.473897    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7pzx_011f5db6-2d23-4056-91ce-209f7ba685d7/egress-router-binary-copy/0.log"
Sep 18 13:59:30.504604 ip-10-0-136-225 kubenswrapper[2564]: I0918 13:59:30.504577    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7pzx_011f5db6-2d23-4056-91ce-209f7ba685d7/cni-plugins/0.log"