Sep 10 20:55:57.107043 ip-10-0-135-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 20:55:57.107057 ip-10-0-135-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 20:55:57.107067 ip-10-0-135-116 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 20:55:57.107489 ip-10-0-135-116 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 20:56:07.329151 ip-10-0-135-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 20:56:07.329167 ip-10-0-135-116 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 12c7696ee0bb4bcf96a3a2eec1cb312b --
Sep 10 20:57:57.448726 ip-10-0-135-116 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 20:57:57.854060 ip-10-0-135-116 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:57.854060 ip-10-0-135-116 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 20:57:57.854060 ip-10-0-135-116 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:57.854060 ip-10-0-135-116 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 20:57:57.854060 ip-10-0-135-116 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:57:57.855361 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.855270    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 20:57:57.860246 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860227    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:57.860246 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860245    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:57.860246 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860249    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860256    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860261    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860264    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860267    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860270    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860273    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860275    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860278    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860281    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860284    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860286    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860289    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860292    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860294    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860297    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860300    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860304    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860306    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:57.860341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860309    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860312    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860315    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860317    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860320    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860322    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860325    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860328    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860331    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860334    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860337    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860340    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860343    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860345    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860348    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860351    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860354    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860357    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860360    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:57.860812 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860362    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860365    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860368    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860370    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860373    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860376    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860378    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860381    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860384    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860386    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860391    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860406    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860410    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860413    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860415    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860419    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860422    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860425    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860428    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860431    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:57.861276 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860434    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860437    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860440    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860442    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860445    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860448    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860451    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860454    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860457    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860459    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860462    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860465    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860468    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860470    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860473    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860475    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860478    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860480    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860484    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860486    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:57.861811 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860489    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860491    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860494    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860497    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860501    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860505    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860508    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860511    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860513    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860517    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860519    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860522    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860525    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860528    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860531    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860533    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860536    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860539    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.860542    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861260    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:57.862291 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861266    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861270    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861273    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861275    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861284    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861287    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861290    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861293    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861295    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861298    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861301    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861303    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861306    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861308    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861311    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861314    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861316    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861319    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861321    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861324    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861326    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:57.862804 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861329    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861331    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861334    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861337    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861339    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861342    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861345    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861347    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861349    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861352    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861355    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861358    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861362    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861366    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861370    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861373    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861382    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861385    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861388    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861390    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:57.863336 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861393    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861410    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861413    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861416    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861418    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861421    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861424    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861427    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861429    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861432    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861434    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861437    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861440    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861442    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861445    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861449    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861454    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861457    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861460    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:57.863844 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861463    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861466    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861469    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861472    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861474    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861477    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861480    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861483    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861485    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861488    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861491    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861494    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861496    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861499    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861502    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861504    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861507    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861510    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861513    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:57.864314 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861515    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861519    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861522    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861524    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861527    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861529    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861532    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861535    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861537    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861540    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861543    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861545    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861548    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861550    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861553    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861555    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861558    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861560    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861563    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861959    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:57.864799 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861964    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861967    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861969    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861973    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861975    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861978    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861981    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861984    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861987    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861990    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861992    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861995    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.861998    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862001    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862003    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862006    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862008    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862011    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862013    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862016    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:57.865285 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862019    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862021    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862024    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862026    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862029    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862031    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862034    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862037    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862040    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862042    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862045    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862050    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862052    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862056    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862058    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862061    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862064    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862066    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862069    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862071    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:57.865782 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862074    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862076    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862079    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862081    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862084    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862087    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862089    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862092    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862095    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862098    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862100    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862103    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862105    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862108    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862111    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862114    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862116    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862119    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862121    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862124    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:57.866271 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862127    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862129    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862131    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862135    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862138    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862141    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862143    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862146    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862149    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862152    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862154    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862158    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862161    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862163    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862166    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862168    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862171    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862173    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862176    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862178    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:57.866824 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862181    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862183    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862186    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862189    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862191    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862194    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862197    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862199    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862202    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862204    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862207    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862209    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862212    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862214    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862217    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862222    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862227    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.862230    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862318    2573 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 20:57:57.867321 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862359    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862368    2573 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862373    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862379    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862382    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862387    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862392    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862412    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862415    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862419    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862422    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862426    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862429    2573 flags.go:64] FLAG: --cgroup-root=""
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862432    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862435    2573 flags.go:64] FLAG: --client-ca-file=""
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862438    2573 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862441    2573 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862447    2573 flags.go:64] FLAG: --cluster-domain=""
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862450    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862453    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862456    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862460    2573 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862464    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 20:57:57.867802 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862467    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862470    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862473    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862477    2573 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862480    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862484    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862487    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862490    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862494    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862497    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862502    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862505    2573 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862508    2573 flags.go:64] FLAG: --enable-server="true"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862511    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862516    2573 flags.go:64] FLAG: --event-burst="100"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862520    2573 flags.go:64] FLAG: --event-qps="50"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862522    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862525    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862528    2573 flags.go:64] FLAG: --eviction-hard=""
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862532    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862535    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862538    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862541    2573 flags.go:64] FLAG: --eviction-soft=""
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862544    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862547    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 20:57:57.868358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862550    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862553    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862556    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862559    2573 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862562    2573 flags.go:64] FLAG: --feature-gates=""
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862566    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862569    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862572    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862576    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862579    2573 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862582    2573 flags.go:64] FLAG: --help="false"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862585    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-135-116.ec2.internal"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862589    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862592    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862595    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862598    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862602    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862606    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862609    2573 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862612    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862615    2573 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862619    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862622    2573 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862625    2573 flags.go:64] FLAG: --kube-reserved=""
Sep 10 20:57:57.868992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862628    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862631    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862634    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862637    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862640    2573 flags.go:64] FLAG: --lock-file=""
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862643    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862646    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862649    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862654    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862657    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862660    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862663    2573 flags.go:64] FLAG: --logging-format="text"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862666    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862670    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862673    2573 flags.go:64] FLAG: --manifest-url=""
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862676    2573 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862680    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862683    2573 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862687    2573 flags.go:64] FLAG: --max-pods="110"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862690    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862700    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862704    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862707    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862710    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862713    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 20:57:57.869603 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862718    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862725    2573 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862728    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862732    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862735    2573 flags.go:64] FLAG: --pod-cidr=""
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862739    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862744    2573 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862748    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862751    2573 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862754    2573 flags.go:64] FLAG: --port="10250"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862757    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862760    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0170fbb371efbc65d"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862763    2573 flags.go:64] FLAG: --qos-reserved=""
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862766    2573 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862769    2573 flags.go:64] FLAG: --register-node="true"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862772    2573 flags.go:64] FLAG: --register-with-taints=""
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862776    2573 flags.go:64] FLAG: --registry-burst="10"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862779    2573 flags.go:64] FLAG: --registry-qps="5"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862783    2573 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862786    2573 flags.go:64] FLAG: --reserved-memory=""
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862789    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862792    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862795    2573 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862798    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862801    2573 flags.go:64] FLAG: --runonce="false"
Sep 10 20:57:57.870254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862804    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862807    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862810    2573 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862813    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862816    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862819    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862823    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862827    2573 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862830    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862834    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862837    2573 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862840    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862843    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862846    2573 flags.go:64] FLAG: --system-cgroups=""
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862849    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862855    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862857    2573 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862860    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862865    2573 flags.go:64] FLAG: --tls-min-version=""
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862868    2573 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862871    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862874    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862877    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862880    2573 flags.go:64] FLAG: --v="2"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862884    2573 flags.go:64] FLAG: --version="false"
Sep 10 20:57:57.870932 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862888    2573 flags.go:64] FLAG: --vmodule=""
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862892    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.862897    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863023    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863027    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863030    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863033    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863036    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863040    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863043    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863046    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863049    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863052    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863054    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863058    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863061    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863064    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863067    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863069    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:57.871565 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863072    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863075    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863078    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863081    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863084    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863086    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863089    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863092    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863094    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863097    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863099    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863102    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863105    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863107    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863110    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863114    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863117    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863120    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863122    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863125    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:57.872039 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863128    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863131    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863133    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863136    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863138    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863141    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863144    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863148    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863150    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863153    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863156    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863159    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863161    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863164    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863167    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863171    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863174    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863176    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863179    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863182    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:57.872537 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863185    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863187    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863190    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863193    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863195    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863198    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863200    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863205    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863208    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863210    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863213    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863216    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863219    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863221    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863224    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863227    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863229    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863232    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863236    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:57.873029 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863241    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863244    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863247    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863250    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863253    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863256    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863259    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863262    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863265    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863268    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863270    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863273    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863276    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863278    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863281    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863284    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863286    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863289    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863311    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:57.873551 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863315    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863319    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863323    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863326    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.863328    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.863334    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.870254    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.870270    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.871009    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.871017    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871075    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871080    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871084    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871088    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871091    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:57.874015 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871094    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871097    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871100    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871102    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871106    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871108    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871111    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871114    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871117    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871120    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871123    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871126    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871129    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871131    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871134    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871137    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871139    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871142    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871145    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:57.874391 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871149    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871153    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871156    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871159    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871162    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871166    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871169    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871172    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871175    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871177    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871180    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871183    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871186    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871189    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871192    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871194    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871197    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871199    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871202    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871205    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:57.874874 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871208    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871211    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871214    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871216    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871219    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871222    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871224    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871228    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871232    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871235    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871238    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871241    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871244    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871247    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871249    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871253    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871255    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871259    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871262    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:57.875363 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871265    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871267    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871270    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871273    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871275    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871278    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871281    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871283    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871286    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871289    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871291    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871294    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871296    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871299    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871302    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871304    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871307    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871310    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871312    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871315    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:57.875850 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871317    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871320    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871324    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871328    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871331    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871333    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871336    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871339    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871341    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871344    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871347    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871350    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871353    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871356    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871359    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:57.876341 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871361    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.871366    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871524    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871530    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871534    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871537    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871540    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871543    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871545    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871548    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871550    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871553    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871555    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871558    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871561    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:57:57.876732 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871564    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871566    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871569    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871572    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871574    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871577    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871580    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871584    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871587    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871591    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871593    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871596    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871600    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871603    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871605    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871609    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871611    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871614    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871617    2573 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871620    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:57:57.877124 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871622    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871625    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871628    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871630    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871633    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871636    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871638    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871641    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871643    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871646    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871649    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871652    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871654    2573 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871657    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871660    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871662    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871665    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871668    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871670    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871673    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:57:57.877632 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871675    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871678    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871680    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871683    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871685    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871688    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871691    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871694    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871698    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871701    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871703    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871706    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871709    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871712    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871714    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871717    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871720    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871722    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871725    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:57:57.878135 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871728    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871730    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871733    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871735    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871738    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871741    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871743    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871746    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871750    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871754    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871756    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871759    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871762    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871765    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871767    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871770    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871773    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871775    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871778    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871780    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:57:57.878841 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871783    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871785    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871789    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871791    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871794    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871796    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:57.871799    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.871804    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.871920    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.873815    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.874708    2573 server.go:1019] "Starting client certificate rotation"
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.874807    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.875437    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:57:57.879654 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.877124    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:57:57.881642 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.881579    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:57:57.894843 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.894822    2573 log.go:25] "Validated CRI v1 runtime API"
Sep 10 20:57:57.897756 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.897736    2573 log.go:25] "Validated CRI v1 image API"
Sep 10 20:57:57.899360 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.899334    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 20:57:57.901562 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.901545    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:57.902765 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.902728    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c56803cc-2898-4f12-8020-6adb058ed065:/dev/nvme0n1p4 f69a515e-fc08-4c96-965e-8c4f05817e32:/dev/nvme0n1p3]
Sep 10 20:57:57.902817 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.902766    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 20:57:57.909462 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.909288    2573 manager.go:216] Machine: {Timestamp:2026-09-10 20:57:57.907810238 +0000 UTC m=+0.341640189 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101530 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec268d87d3f031b3096ba70419839d44 SystemUUID:ec268d87-d3f0-31b3-096b-a70419839d44 BootID:12c7696e-e0bb-4bcf-96a3-a2eec1cb312b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:30:4c:8c:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:30:4c:8c:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:86:dc:ea:43:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 20:57:57.909462 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.909453    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 20:57:57.909586 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.909555    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 20:57:57.912919 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.912892    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 20:57:57.913084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.912922    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 20:57:57.913579 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.913567    2573 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 20:57:57.913622 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.913580    2573 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 20:57:57.913622 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.913594    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:57:57.914291 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.914280    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:57:57.915078 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.915066    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 20:57:57.918355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918342    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:57:57.918490 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918480    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 20:57:57.918532 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918514    2573 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 20:57:57.918532 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918525    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 20:57:57.918617 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918542    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 20:57:57.918617 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918552    2573 kubelet.go:398] "Adding apiserver pod source"
Sep 10 20:57:57.918617 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.918562    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 20:57:57.919042 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.919026    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:57:57.919094 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.919059    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:57:57.921599 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.921560    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 20:57:57.925070 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.925041    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 20:57:57.925145 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.925100    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 20:57:57.926643 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926627    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926651    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926661    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926670    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926682    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926691    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926718    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 20:57:57.926729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926726    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 20:57:57.926989 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926736    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 20:57:57.926989 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926745    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 20:57:57.926989 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926771    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 20:57:57.926989 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926780    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 20:57:57.926989 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.926829    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tqh2"
Sep 10 20:57:57.927904 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:57.927882    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 20:57:57.927904 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:57.927882    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 20:57:57.928374 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.928360    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 20:57:57.928457 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.928376    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 20:57:57.932824 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.932809    2573 server.go:1268] "Started kubelet"
Sep 10 20:57:57.933099 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.933044    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 20:57:57.933099 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.933087    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 20:57:57.933210 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.933125    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 20:57:57.933816 ip-10-0-135-116 systemd[1]: Started Kubernetes Kubelet.
Sep 10 20:57:57.934257 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.934232    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 20:57:57.935151 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.935139    2573 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 20:57:57.936906 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.936883    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tqh2"
Sep 10 20:57:57.937786 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:57.937765    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 20:57:57.939229 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.939207    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 20:57:57.940221 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:57.939255    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-116.ec2.internal.18d411368b1d389c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-116.ec2.internal,UID:ip-10-0-135-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-116.ec2.internal,},FirstTimestamp:2026-09-10 20:57:57.932783772 +0000 UTC m=+0.366613713,LastTimestamp:2026-09-10 20:57:57.932783772 +0000 UTC m=+0.366613713,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-116.ec2.internal,}"
Sep 10 20:57:57.940503 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.940483    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:57.941026 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941008    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 20:57:57.941284 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:57.941132    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:57.941666 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941640    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 20:57:57.941666 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941658    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 20:57:57.941804 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941640    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 20:57:57.941841 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941806    2573 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 20:57:57.941841 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941835    2573 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 20:57:57.941957 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941939    2573 factory.go:55] Registering systemd factory
Sep 10 20:57:57.942056 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.941968    2573 factory.go:223] Registration of the systemd container factory successfully
Sep 10 20:57:57.942233 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.942217    2573 factory.go:153] Registering CRI-O factory
Sep 10 20:57:57.942295 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.942235    2573 factory.go:223] Registration of the crio container factory successfully
Sep 10 20:57:57.942295 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.942289    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 20:57:57.942389 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.942308    2573 factory.go:103] Registering Raw factory
Sep 10 20:57:57.942389 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.942322    2573 manager.go:1196] Started watching for new ooms in manager
Sep 10 20:57:57.943188 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.942928    2573 manager.go:349] Starting recovery of all containers
Sep 10 20:57:57.949041 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.948841    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:57.953345 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:57.953320    2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-116.ec2.internal\" not found" node="ip-10-0-135-116.ec2.internal"
Sep 10 20:57:57.959579 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.959479    2573 manager.go:354] Recovery completed
Sep 10 20:57:57.964976 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.964961    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:57.967770 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.967753    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:57.967855 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.967784    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:57.967855 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.967795    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:57.968409 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.968382    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 20:57:57.968486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.968409    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:57.968486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.968424    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 20:57:57.968486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.968441    2573 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:57:57.969127 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.969111    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:57.969189 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.969139    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:57.969189 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.969151    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:57.969705 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.969692    2573 policy_none.go:49] "None policy: Start"
Sep 10 20:57:57.969744 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.969708    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 20:57:57.969744 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.969718    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 20:57:57.970725 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:57.970691    2573 policy_none.go:47] "Start"
Sep 10 20:57:58.011070 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011052    2573 manager.go:337] "Starting Device Plugin manager"
Sep 10 20:57:58.011225 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.011099    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 20:57:58.011225 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011110    2573 server.go:87] "Starting device plugin registration server"
Sep 10 20:57:58.011492 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011480    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 20:57:58.011554 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011494    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 20:57:58.011609 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011596    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 20:57:58.011745 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011698    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 20:57:58.011745 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.011710    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 20:57:58.012230 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.012212    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 20:57:58.012361 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.012263    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.034846 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.034809    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 20:57:58.036055 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.036033    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 20:57:58.036155 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.036095    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 20:57:58.036155 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.036125    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 20:57:58.036253 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.036230    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 20:57:58.038735 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.038710    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:58.111988 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.111871    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:58.113044 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.113027    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:58.113141 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.113058    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:58.113141 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.113068    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:58.113141 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.113115    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.121737 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.121719    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.121844 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.121745    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-116.ec2.internal\": node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.136675 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.136648    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"]
Sep 10 20:57:58.136787 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.136731    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:58.138232 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.138216    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:58.138323 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.138243    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:58.138323 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.138252    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:58.139538 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.139525    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:58.139665 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.139651    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.139701 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.139682    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:58.140254 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.140238    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:58.140331 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.140261    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:58.140331 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.140270    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:58.140331 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.140240    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:58.140466 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.140334    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:58.140466 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.140345    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:58.141370 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.141355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.141431 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.141393    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:57:58.142116 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.142099    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:57:58.142167 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.142133    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:57:58.142167 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.142148    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:57:58.142718 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.142701    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.142785 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.142770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ee37362506138ee29eeccd68e40c0bf-config\") pod \"kube-apiserver-proxy-ip-10-0-135-116.ec2.internal\" (UID: \"4ee37362506138ee29eeccd68e40c0bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.142823 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.142794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e5aaed7550f49767f81ba0dc1f58c32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal\" (UID: \"1e5aaed7550f49767f81ba0dc1f58c32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.142823 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.142809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e5aaed7550f49767f81ba0dc1f58c32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal\" (UID: \"1e5aaed7550f49767f81ba0dc1f58c32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.162165 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.162144    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-116.ec2.internal\" not found" node="ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.166728 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.166708    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-116.ec2.internal\" not found" node="ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.243273 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.243235    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.243479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.243284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e5aaed7550f49767f81ba0dc1f58c32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal\" (UID: \"1e5aaed7550f49767f81ba0dc1f58c32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.243479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.243328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ee37362506138ee29eeccd68e40c0bf-config\") pod \"kube-apiserver-proxy-ip-10-0-135-116.ec2.internal\" (UID: \"4ee37362506138ee29eeccd68e40c0bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.243479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.243349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e5aaed7550f49767f81ba0dc1f58c32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal\" (UID: \"1e5aaed7550f49767f81ba0dc1f58c32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.243479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.243367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e5aaed7550f49767f81ba0dc1f58c32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal\" (UID: \"1e5aaed7550f49767f81ba0dc1f58c32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.243479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.243381    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e5aaed7550f49767f81ba0dc1f58c32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal\" (UID: \"1e5aaed7550f49767f81ba0dc1f58c32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.243479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.243427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ee37362506138ee29eeccd68e40c0bf-config\") pod \"kube-apiserver-proxy-ip-10-0-135-116.ec2.internal\" (UID: \"4ee37362506138ee29eeccd68e40c0bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.343389 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.343356    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.444120 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.444050    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.465263 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.465214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.469188 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.469167    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.545048 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.545018    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.645376 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.645346    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.745902 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.745829    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.846003 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.845961    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-116.ec2.internal\" not found"
Sep 10 20:57:58.846151 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.846074    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:58.875056 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.875007    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 20:57:58.875568 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.875193    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:58.875568 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.875227    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:58.875568 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.875227    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:58.917616 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.917412    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:58.919023 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.919005    2573 apiserver.go:52] "Watching apiserver"
Sep 10 20:57:58.928155 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.928131    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 20:57:58.928510 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.928488    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-54wrf","kube-system/global-pull-secret-syncer-g2g24","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf","openshift-network-operator/iptables-alerter-cz5x7","openshift-ovn-kubernetes/ovnkube-node-xx4mh","kube-system/konnectivity-agent-blzx5","openshift-cluster-node-tuning-operator/tuned-bqsvr","openshift-dns/node-resolver-4tn5w","openshift-image-registry/node-ca-4psvv","openshift-multus/multus-additional-cni-plugins-c8hq8","openshift-multus/multus-fk6mv","openshift-multus/network-metrics-daemon-v8pqm"]
Sep 10 20:57:58.929882 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.929864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:57:58.929963 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.929944    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:57:58.930801 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.930785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:58.930918 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.930897    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:57:58.931686 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.931671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.932709 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.932681    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:58.933620 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.933593    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 20:57:58.933709 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.933695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zgj7m\""
Sep 10 20:57:58.933765 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.933746    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.933765 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.933753    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.934044 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.934027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.934840 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.934823    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.935125 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.935109    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 20:57:58.935258 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.935241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w75tm\""
Sep 10 20:57:58.935361 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.935346    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.935435 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.935423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:58.935875 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.935859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 20:57:58.936080 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936062    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.936340 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.936623 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936490    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 20:57:58.936623 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936511    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7nkj\""
Sep 10 20:57:58.936623 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936534    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.936850 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936835    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 20:57:58.936905 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.936872    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 20:57:58.937555 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.937539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:58.938007 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.937958    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 20:57:58.938079 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.938018    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g97jb\""
Sep 10 20:57:58.938079 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.938055    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 20:57:58.938442 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.938426    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rxq64\""
Sep 10 20:57:58.938790 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.938767    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.939240 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.939216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:58.940032 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.939408    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.940781 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.940542    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.940781 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.940750    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pzmx8\""
Sep 10 20:57:58.941060 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.941040    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.941126 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.941082    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 20:52:58 +0000 UTC" deadline="2028-04-02 18:02:36.831918185 +0000 UTC"
Sep 10 20:57:58.941126 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.941121    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13677h4m37.890800588s"
Sep 10 20:57:58.941416 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.941329    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:58.941509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.941467    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.942675 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.941898    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.942675 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.942550    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rdjvf\""
Sep 10 20:57:58.942830 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.942721    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.944169 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.943156    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.944169 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.943341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 20:57:58.944758 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.944736    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:58.945993 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.945972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:58.946102 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:58.946033    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:57:58.946191 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946174    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 20:57:58.946284 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40579060-85b2-4b38-9eb7-2a97dfb3780b-kubelet-config\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:58.946337 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwnz\" (UniqueName: \"kubernetes.io/projected/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-kube-api-access-9rwnz\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:58.946337 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946307    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 20:57:58.946635 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946618    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 20:57:58.946835 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-var-lib-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.946835 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946839    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2tmcl\""
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-etc-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-ovn\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946893    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-serviceca\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-iptables-alerter-script\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-kubelet\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.946995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.946994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-slash\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-kubernetes\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-run-netns\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947075    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcmdd\""
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-log-socket\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947127    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947154    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4qx\" (UniqueName: \"kubernetes.io/projected/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-kube-api-access-qw4qx\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947164    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40579060-85b2-4b38-9eb7-2a97dfb3780b-dbus\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-sys\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-systemd-units\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-node-log\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-cni-bin\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.947427 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-lib-modules\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-var-lib-kubelet\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-run-ovn-kubernetes\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c103b925-1865-47bd-b5ff-5130a6442493-etc-tuned\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947528    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-sys-fs\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-systemd\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-modprobe-d\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c103b925-1865-47bd-b5ff-5130a6442493-tmp\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cnibin\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947734    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-host-slash\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-system-cni-dir\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-systemd\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-host\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-ovnkube-script-lib\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948004 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysctl-d\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdhj\" (UniqueName: \"kubernetes.io/projected/f879ab19-b363-456c-af14-98ee53909f21-kube-api-access-pjdhj\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7938aa9-84a2-4ea2-a2db-bad2cb530c10-konnectivity-ca\") pod \"konnectivity-agent-blzx5\" (UID: \"f7938aa9-84a2-4ea2-a2db-bad2cb530c10\") " pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-cni-netd\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.947993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88948997-10ae-459b-bb46-4b7fa8705cf9-ovn-node-metrics-cert\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-socket-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948090    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7938aa9-84a2-4ea2-a2db-bad2cb530c10-agent-certs\") pod \"konnectivity-agent-blzx5\" (UID: \"f7938aa9-84a2-4ea2-a2db-bad2cb530c10\") " pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-hosts-file\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-tmp-dir\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948164    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd62f\" (UniqueName: \"kubernetes.io/projected/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-kube-api-access-hd62f\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-ovnkube-config\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-host\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:58.948732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5hd\" (UniqueName: \"kubernetes.io/projected/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-kube-api-access-qw5hd\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-device-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysconfig\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysctl-conf\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-run\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-registration-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-env-overrides\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmhbs\" (UniqueName: \"kubernetes.io/projected/88948997-10ae-459b-bb46-4b7fa8705cf9-kube-api-access-qmhbs\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:58.949547 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.948516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpqv\" (UniqueName: \"kubernetes.io/projected/c103b925-1865-47bd-b5ff-5130a6442493-kube-api-access-hjpqv\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:58.951556 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.951538    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:58.953008 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.952990    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:58.953089 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.953045    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal"]
Sep 10 20:57:58.953155 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.953113    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"
Sep 10 20:57:58.961611 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.961594    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:58.961723 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.961708    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal"]
Sep 10 20:57:58.981819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.981795    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzsl2"
Sep 10 20:57:58.989275 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:58.989256    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzsl2"
Sep 10 20:57:59.027315 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.027277    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5aaed7550f49767f81ba0dc1f58c32.slice/crio-7db4590499ea6ca829576d52bf9871954d7d5fe880f4883ab30434588e2ab547 WatchSource:0}: Error finding container 7db4590499ea6ca829576d52bf9871954d7d5fe880f4883ab30434588e2ab547: Status 404 returned error can't find the container with id 7db4590499ea6ca829576d52bf9871954d7d5fe880f4883ab30434588e2ab547
Sep 10 20:57:59.027674 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.027650    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee37362506138ee29eeccd68e40c0bf.slice/crio-069e4e8b80bea65eed37ec2495a0b014ed17c573536df5b92a90d2206a3a549c WatchSource:0}: Error finding container 069e4e8b80bea65eed37ec2495a0b014ed17c573536df5b92a90d2206a3a549c: Status 404 returned error can't find the container with id 069e4e8b80bea65eed37ec2495a0b014ed17c573536df5b92a90d2206a3a549c
Sep 10 20:57:59.033201 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.033183    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:57:59.039762 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.039726    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal" event={"ID":"4ee37362506138ee29eeccd68e40c0bf","Type":"ContainerStarted","Data":"069e4e8b80bea65eed37ec2495a0b014ed17c573536df5b92a90d2206a3a549c"}
Sep 10 20:57:59.041631 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.041606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal" event={"ID":"1e5aaed7550f49767f81ba0dc1f58c32","Type":"ContainerStarted","Data":"7db4590499ea6ca829576d52bf9871954d7d5fe880f4883ab30434588e2ab547"}
Sep 10 20:57:59.043071 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.043056    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 20:57:59.048740 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.048839 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-systemd\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.048839 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-modprobe-d\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.048839 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c103b925-1865-47bd-b5ff-5130a6442493-tmp\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.048999 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-modprobe-d\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.048999 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.048999 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.048992    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-systemd\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.049132 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-etc-kubernetes\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.049132 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cnibin\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.049132 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-host-slash\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.049267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-host-slash\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.049267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-system-cni-dir\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.049267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049206    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cnibin\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.049267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049239    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-system-cni-dir\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.049267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-systemd\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-host\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-ovnkube-script-lib\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049356    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-systemd\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysctl-d\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049419    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-host\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdhj\" (UniqueName: \"kubernetes.io/projected/f879ab19-b363-456c-af14-98ee53909f21-kube-api-access-pjdhj\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7938aa9-84a2-4ea2-a2db-bad2cb530c10-konnectivity-ca\") pod \"konnectivity-agent-blzx5\" (UID: \"f7938aa9-84a2-4ea2-a2db-bad2cb530c10\") " pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-cni-netd\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.049509 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88948997-10ae-459b-bb46-4b7fa8705cf9-ovn-node-metrics-cert\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysctl-d\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f6de03c-5454-4b85-be6e-d6cec7612e65-cni-binary-copy\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-socket-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.049612    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049509    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7938aa9-84a2-4ea2-a2db-bad2cb530c10-agent-certs\") pod \"konnectivity-agent-blzx5\" (UID: \"f7938aa9-84a2-4ea2-a2db-bad2cb530c10\") " pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.049675    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:57:59.549654518 +0000 UTC m=+1.983484465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-hosts-file\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-tmp-dir\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049752    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqnc\" (UniqueName: \"kubernetes.io/projected/2404ec37-e8a7-4eb2-b841-a20815a2464a-kube-api-access-6lqnc\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd62f\" (UniqueName: \"kubernetes.io/projected/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-kube-api-access-hd62f\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-ovnkube-config\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-host\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.050016 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049869    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5hd\" (UniqueName: \"kubernetes.io/projected/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-kube-api-access-qw5hd\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-device-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.049960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysconfig\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysctl-conf\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-run\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-system-cni-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050092    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-registration-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-env-overrides\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmhbs\" (UniqueName: \"kubernetes.io/projected/88948997-10ae-459b-bb46-4b7fa8705cf9-kube-api-access-qmhbs\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpqv\" (UniqueName: \"kubernetes.io/projected/c103b925-1865-47bd-b5ff-5130a6442493-kube-api-access-hjpqv\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-conf-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050205    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9f7\" (UniqueName: \"kubernetes.io/projected/2f6de03c-5454-4b85-be6e-d6cec7612e65-kube-api-access-9c9f7\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40579060-85b2-4b38-9eb7-2a97dfb3780b-kubelet-config\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050262    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwnz\" (UniqueName: \"kubernetes.io/projected/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-kube-api-access-9rwnz\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-var-lib-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.050898 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-etc-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050082    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-ovnkube-script-lib\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050354    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-ovn\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-cni-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-cni-bin\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050485    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-serviceca\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-hosts-file\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050654    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-iptables-alerter-script\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-kubelet\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-slash\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-kubernetes\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050810    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-netns\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050826    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7938aa9-84a2-4ea2-a2db-bad2cb530c10-konnectivity-ca\") pod \"konnectivity-agent-blzx5\" (UID: \"f7938aa9-84a2-4ea2-a2db-bad2cb530c10\") " pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050836    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-ovnkube-config\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.051696 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-run-netns\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-log-socket\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-run-netns\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4qx\" (UniqueName: \"kubernetes.io/projected/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-kube-api-access-qw4qx\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-k8s-cni-cncf-io\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-serviceca\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.050991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-cni-multus\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051003    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051017    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40579060-85b2-4b38-9eb7-2a97dfb3780b-dbus\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-sys\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051080    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-socket-dir-parent\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-kubelet\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051134    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-tmp-dir\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051180    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-systemd-units\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-cni-netd\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.052285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-run\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-var-lib-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-etc-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051520    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-openvswitch\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-device-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-log-socket\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-node-log\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-cni-bin\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051633    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-kubernetes\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-lib-modules\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-var-lib-kubelet\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-cnibin\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysconfig\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-hostroot\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-run-ovn-kubernetes\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c103b925-1865-47bd-b5ff-5130a6442493-etc-tuned\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-daemon-config\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.053027 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051679    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-host\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-multus-certs\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.051975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-sys-fs\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052070    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-sys-fs\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40579060-85b2-4b38-9eb7-2a97dfb3780b-kubelet-config\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-node-log\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-cni-bin\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-lib-modules\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-var-lib-kubelet\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052348    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-run-ovn-kubernetes\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88948997-10ae-459b-bb46-4b7fa8705cf9-env-overrides\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052509    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-run-ovn\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052589    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052638    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-sys\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40579060-85b2-4b38-9eb7-2a97dfb3780b-dbus\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052813    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-socket-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052855    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-kubelet\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052940    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c103b925-1865-47bd-b5ff-5130a6442493-etc-sysctl-conf\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.053865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.052981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-host-slash\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88948997-10ae-459b-bb46-4b7fa8705cf9-systemd-units\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053074    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f879ab19-b363-456c-af14-98ee53909f21-registration-dir\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053427    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c103b925-1865-47bd-b5ff-5130a6442493-tmp\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88948997-10ae-459b-bb46-4b7fa8705cf9-ovn-node-metrics-cert\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053976    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053989    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7938aa9-84a2-4ea2-a2db-bad2cb530c10-agent-certs\") pod \"konnectivity-agent-blzx5\" (UID: \"f7938aa9-84a2-4ea2-a2db-bad2cb530c10\") " pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.053999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-iptables-alerter-script\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.054494 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.054376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c103b925-1865-47bd-b5ff-5130a6442493-etc-tuned\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.058811 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.058793    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:59.058904 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.058819    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:59.058904 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.058831    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:59.059014 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.058936    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:59.558909963 +0000 UTC m=+1.992739914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:59.060850 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.060823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5hd\" (UniqueName: \"kubernetes.io/projected/01ccbe4d-ba0b-4888-b17e-e9f340c2d548-kube-api-access-qw5hd\") pod \"node-ca-4psvv\" (UID: \"01ccbe4d-ba0b-4888-b17e-e9f340c2d548\") " pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.061246 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.061221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmhbs\" (UniqueName: \"kubernetes.io/projected/88948997-10ae-459b-bb46-4b7fa8705cf9-kube-api-access-qmhbs\") pod \"ovnkube-node-xx4mh\" (UID: \"88948997-10ae-459b-bb46-4b7fa8705cf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.061530 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.061506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdhj\" (UniqueName: \"kubernetes.io/projected/f879ab19-b363-456c-af14-98ee53909f21-kube-api-access-pjdhj\") pod \"aws-ebs-csi-driver-node-nrqgf\" (UID: \"f879ab19-b363-456c-af14-98ee53909f21\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.061859 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.061838    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4qx\" (UniqueName: \"kubernetes.io/projected/4c221f57-edf1-4e02-a377-5c5ecb6bf30c-kube-api-access-qw4qx\") pod \"node-resolver-4tn5w\" (UID: \"4c221f57-edf1-4e02-a377-5c5ecb6bf30c\") " pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.062084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.062062    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwnz\" (UniqueName: \"kubernetes.io/projected/7d09cae3-10ac-47fb-afb5-efcc4c54a7b3-kube-api-access-9rwnz\") pod \"iptables-alerter-cz5x7\" (UID: \"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3\") " pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.062227 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.062211    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpqv\" (UniqueName: \"kubernetes.io/projected/c103b925-1865-47bd-b5ff-5130a6442493-kube-api-access-hjpqv\") pod \"tuned-bqsvr\" (UID: \"c103b925-1865-47bd-b5ff-5130a6442493\") " pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.062276 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.062224    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd62f\" (UniqueName: \"kubernetes.io/projected/17ea9f04-bab4-40c3-a21a-80e3dd44ecd9-kube-api-access-hd62f\") pod \"multus-additional-cni-plugins-c8hq8\" (UID: \"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9\") " pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.152477 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-cnibin\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152477 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-hostroot\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-daemon-config\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-multus-certs\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-etc-kubernetes\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f6de03c-5454-4b85-be6e-d6cec7612e65-cni-binary-copy\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-hostroot\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152582    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-cnibin\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152610    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-multus-certs\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-etc-kubernetes\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.152703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqnc\" (UniqueName: \"kubernetes.io/projected/2404ec37-e8a7-4eb2-b841-a20815a2464a-kube-api-access-6lqnc\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-system-cni-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-conf-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9f7\" (UniqueName: \"kubernetes.io/projected/2f6de03c-5454-4b85-be6e-d6cec7612e65-kube-api-access-9c9f7\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-cni-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152829    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-conf-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-system-cni-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-cni-bin\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-netns\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-cni-dir\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-k8s-cni-cncf-io\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-netns\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152946    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-cni-multus\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152951    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-run-k8s-cni-cncf-io\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152892    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-cni-bin\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152976    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-socket-dir-parent\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.152980    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-cni-multus\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.153003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-kubelet\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153084 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.153023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-socket-dir-parent\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153665 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.153035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:59.153665 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.153035    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f6de03c-5454-4b85-be6e-d6cec7612e65-host-var-lib-kubelet\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153665 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.153147    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:59.153665 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.153157    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f6de03c-5454-4b85-be6e-d6cec7612e65-cni-binary-copy\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153665 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.153171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f6de03c-5454-4b85-be6e-d6cec7612e65-multus-daemon-config\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.153665 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.153198    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:57:59.653181481 +0000 UTC m=+2.087011425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:59.163144 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.163120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9f7\" (UniqueName: \"kubernetes.io/projected/2f6de03c-5454-4b85-be6e-d6cec7612e65-kube-api-access-9c9f7\") pod \"multus-fk6mv\" (UID: \"2f6de03c-5454-4b85-be6e-d6cec7612e65\") " pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.163261 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.163153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqnc\" (UniqueName: \"kubernetes.io/projected/2404ec37-e8a7-4eb2-b841-a20815a2464a-kube-api-access-6lqnc\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:59.254646 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.254611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf"
Sep 10 20:57:59.264102 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.264075    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf879ab19_b363_456c_af14_98ee53909f21.slice/crio-a53abdc153a3d484049c7147c7c1874e47001435b10c4af208a2dcf63f752f3d WatchSource:0}: Error finding container a53abdc153a3d484049c7147c7c1874e47001435b10c4af208a2dcf63f752f3d: Status 404 returned error can't find the container with id a53abdc153a3d484049c7147c7c1874e47001435b10c4af208a2dcf63f752f3d
Sep 10 20:57:59.279863 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.279839    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8hq8"
Sep 10 20:57:59.286669 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.286650    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cz5x7"
Sep 10 20:57:59.287116 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.287090    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ea9f04_bab4_40c3_a21a_80e3dd44ecd9.slice/crio-d885f65df55f3ff23a8ce1aa1851901657ddb61a82c32342701968cb0a40aa2f WatchSource:0}: Error finding container d885f65df55f3ff23a8ce1aa1851901657ddb61a82c32342701968cb0a40aa2f: Status 404 returned error can't find the container with id d885f65df55f3ff23a8ce1aa1851901657ddb61a82c32342701968cb0a40aa2f
Sep 10 20:57:59.294438 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.294412    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d09cae3_10ac_47fb_afb5_efcc4c54a7b3.slice/crio-da5c000e6ad3be5449a1c86099fcfb6acfeaffea36bf91bc0d13ed77c5e3ecee WatchSource:0}: Error finding container da5c000e6ad3be5449a1c86099fcfb6acfeaffea36bf91bc0d13ed77c5e3ecee: Status 404 returned error can't find the container with id da5c000e6ad3be5449a1c86099fcfb6acfeaffea36bf91bc0d13ed77c5e3ecee
Sep 10 20:57:59.311049 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.311023    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:57:59.318872 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.318839    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88948997_10ae_459b_bb46_4b7fa8705cf9.slice/crio-df236be8b5e1b6f44e0e9b0c20e729a90af02aa8899523204c8a618c29d762fb WatchSource:0}: Error finding container df236be8b5e1b6f44e0e9b0c20e729a90af02aa8899523204c8a618c29d762fb: Status 404 returned error can't find the container with id df236be8b5e1b6f44e0e9b0c20e729a90af02aa8899523204c8a618c29d762fb
Sep 10 20:57:59.323066 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.323047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:57:59.329000 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.328981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bqsvr"
Sep 10 20:57:59.329936 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.329912    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7938aa9_84a2_4ea2_a2db_bad2cb530c10.slice/crio-156ecdedfc1e2f95aaae7beb7bad9155c54a5b69a6aa209a5a72adc1a50c306c WatchSource:0}: Error finding container 156ecdedfc1e2f95aaae7beb7bad9155c54a5b69a6aa209a5a72adc1a50c306c: Status 404 returned error can't find the container with id 156ecdedfc1e2f95aaae7beb7bad9155c54a5b69a6aa209a5a72adc1a50c306c
Sep 10 20:57:59.336206 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.336179    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc103b925_1865_47bd_b5ff_5130a6442493.slice/crio-a48e9a6bab894ae91c4f3e107e09e3726f491c100f19157b3ad8683fc9d1185c WatchSource:0}: Error finding container a48e9a6bab894ae91c4f3e107e09e3726f491c100f19157b3ad8683fc9d1185c: Status 404 returned error can't find the container with id a48e9a6bab894ae91c4f3e107e09e3726f491c100f19157b3ad8683fc9d1185c
Sep 10 20:57:59.337478 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.337456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tn5w"
Sep 10 20:57:59.343244 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.343219    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4psvv"
Sep 10 20:57:59.345472 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.345322    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c221f57_edf1_4e02_a377_5c5ecb6bf30c.slice/crio-3db0133038d7eb4674bfe6377eee3b6436fea81f750785a09f275a04ddbed054 WatchSource:0}: Error finding container 3db0133038d7eb4674bfe6377eee3b6436fea81f750785a09f275a04ddbed054: Status 404 returned error can't find the container with id 3db0133038d7eb4674bfe6377eee3b6436fea81f750785a09f275a04ddbed054
Sep 10 20:57:59.346270 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.346248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fk6mv"
Sep 10 20:57:59.351819 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.351796    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ccbe4d_ba0b_4888_b17e_e9f340c2d548.slice/crio-dc2e8568d92bbde2d9a27344c6536d1c7128eb986b76b84bdff6c5efe38a1abb WatchSource:0}: Error finding container dc2e8568d92bbde2d9a27344c6536d1c7128eb986b76b84bdff6c5efe38a1abb: Status 404 returned error can't find the container with id dc2e8568d92bbde2d9a27344c6536d1c7128eb986b76b84bdff6c5efe38a1abb
Sep 10 20:57:59.355435 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:57:59.355411    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6de03c_5454_4b85_be6e_d6cec7612e65.slice/crio-02ef875101b3cad899651976beaddba6b3cb1f046f911733edb9319f20e7171d WatchSource:0}: Error finding container 02ef875101b3cad899651976beaddba6b3cb1f046f911733edb9319f20e7171d: Status 404 returned error can't find the container with id 02ef875101b3cad899651976beaddba6b3cb1f046f911733edb9319f20e7171d
Sep 10 20:57:59.557939 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.557630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:57:59.558099 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.557776    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:59.558099 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.558027    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:00.558004049 +0000 UTC m=+2.991833991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:59.658477 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.658438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:57:59.658664 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.658513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:57:59.658664 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.658588    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:59.658664 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.658613    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:59.658833 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.658671    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:58:00.658653577 +0000 UTC m=+3.092483516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:59.658833 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.658614    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:59.658833 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.658707    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:59.658833 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:57:59.658750    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:00.658737215 +0000 UTC m=+3.092567158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:59.991386 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.991248    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:59 +0000 UTC" deadline="2028-02-05 05:20:10.133338323 +0000 UTC"
Sep 10 20:57:59.991386 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:57:59.991310    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12296h22m10.142032221s"
Sep 10 20:58:00.061859 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.061773    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fk6mv" event={"ID":"2f6de03c-5454-4b85-be6e-d6cec7612e65","Type":"ContainerStarted","Data":"02ef875101b3cad899651976beaddba6b3cb1f046f911733edb9319f20e7171d"}
Sep 10 20:58:00.070788 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.070659    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4psvv" event={"ID":"01ccbe4d-ba0b-4888-b17e-e9f340c2d548","Type":"ContainerStarted","Data":"dc2e8568d92bbde2d9a27344c6536d1c7128eb986b76b84bdff6c5efe38a1abb"}
Sep 10 20:58:00.087368 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.087302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tn5w" event={"ID":"4c221f57-edf1-4e02-a377-5c5ecb6bf30c","Type":"ContainerStarted","Data":"3db0133038d7eb4674bfe6377eee3b6436fea81f750785a09f275a04ddbed054"}
Sep 10 20:58:00.112701 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.112656    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqsvr" event={"ID":"c103b925-1865-47bd-b5ff-5130a6442493","Type":"ContainerStarted","Data":"a48e9a6bab894ae91c4f3e107e09e3726f491c100f19157b3ad8683fc9d1185c"}
Sep 10 20:58:00.132192 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.132146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blzx5" event={"ID":"f7938aa9-84a2-4ea2-a2db-bad2cb530c10","Type":"ContainerStarted","Data":"156ecdedfc1e2f95aaae7beb7bad9155c54a5b69a6aa209a5a72adc1a50c306c"}
Sep 10 20:58:00.147425 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.144964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cz5x7" event={"ID":"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3","Type":"ContainerStarted","Data":"da5c000e6ad3be5449a1c86099fcfb6acfeaffea36bf91bc0d13ed77c5e3ecee"}
Sep 10 20:58:00.150595 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.150557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"df236be8b5e1b6f44e0e9b0c20e729a90af02aa8899523204c8a618c29d762fb"}
Sep 10 20:58:00.166464 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.166424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerStarted","Data":"d885f65df55f3ff23a8ce1aa1851901657ddb61a82c32342701968cb0a40aa2f"}
Sep 10 20:58:00.186100 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.186060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf" event={"ID":"f879ab19-b363-456c-af14-98ee53909f21","Type":"ContainerStarted","Data":"a53abdc153a3d484049c7147c7c1874e47001435b10c4af208a2dcf63f752f3d"}
Sep 10 20:58:00.375813 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.375556    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:58:00.445364 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.445131    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:58:00.568163 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.567188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:00.568163 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.567396    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:00.568163 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.567489    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:02.567467588 +0000 UTC m=+5.001297532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.668165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.668252    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.668395    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.668482    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:58:02.66846143 +0000 UTC m=+5.102291374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.668966    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.668988    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.669001    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:00.669094 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:00.669052    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:02.669035354 +0000 UTC m=+5.102865309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:00.992583 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.992428    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:59 +0000 UTC" deadline="2028-03-25 18:32:47.820807 +0000 UTC"
Sep 10 20:58:00.992583 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:00.992471    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13485h34m46.828342357s"
Sep 10 20:58:01.037886 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:01.036862    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:01.037886 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:01.037022    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:01.037886 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:01.037515    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:01.037886 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:01.037622    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:01.037886 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:01.037688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:01.037886 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:01.037760    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:01.936622 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:01.936397    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:58:02.585884 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:02.585222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:02.585884 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.585439    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:02.585884 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.585512    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:06.585494477 +0000 UTC m=+9.019324418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:02.685639 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:02.685601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:02.685873 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:02.685673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:02.685873 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.685806    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:02.685873 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.685870    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:58:06.685852237 +0000 UTC m=+9.119682179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:02.686287 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.686265    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:02.686376 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.686290    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:02.686376 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.686303    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:02.686376 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:02.686347    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:06.68633234 +0000 UTC m=+9.120162282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:03.037110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:03.037077    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:03.037291 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:03.037193    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:03.037536 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:03.037514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:03.037613 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:03.037591    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:03.037673 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:03.037635    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:03.037722 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:03.037678    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:05.037281 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:05.037162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:05.037281 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:05.037211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:05.037845 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:05.037304    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:05.037845 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:05.037379    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:05.037845 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:05.037386    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:05.037845 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:05.037489    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:06.625059 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:06.624938    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:06.625606 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.625084    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:06.625606 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.625170    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:14.62514915 +0000 UTC m=+17.058979100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:06.726173 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:06.726131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:06.726345 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:06.726267    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:06.726417 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.726370    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:06.726481 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.726471    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:58:14.726447002 +0000 UTC m=+17.160276941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:06.726541 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.726496    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:06.726541 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.726522    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:06.726541 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.726537    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:06.726681 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:06.726600    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:14.726571066 +0000 UTC m=+17.160401011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:07.036543 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:07.036411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:07.036543 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:07.036448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:07.036543 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:07.036411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:07.036815 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:07.036594    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:07.036815 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:07.036720    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:07.036908 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:07.036819    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:09.036767 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:09.036734    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:09.037355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:09.036781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:09.037355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:09.036781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:09.037355 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:09.036858    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:09.037355 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:09.036968    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:09.037355 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:09.037060    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:11.036775 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:11.036733    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:11.037251 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:11.036782    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:11.037251 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:11.036783    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:11.037251 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:11.036860    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:11.037251 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:11.036973    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:11.037251 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:11.037051    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:13.037314 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:13.037279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:13.037314 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:13.037293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:13.037877 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:13.037293    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:13.037877 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:13.037420    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:13.037877 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:13.037506    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:13.037877 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:13.037597    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:14.689242 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:14.689197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:14.689878 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.689374    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:14.689878 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.689464    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.689446127 +0000 UTC m=+33.123276057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:14.789977 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:14.789936    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:14.790177 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:14.790005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:14.790177 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.790144    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:14.790177 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.790162    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:14.790391 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.790190    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:14.790391 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.790202    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:14.790391 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.790231    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.79021143 +0000 UTC m=+33.224041375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:14.790391 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:14.790262    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:30.790249663 +0000 UTC m=+33.224079604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:15.036463 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:15.036369    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:15.036463 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:15.036428    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:15.036672 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:15.036372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:15.036672 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:15.036521    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:15.036672 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:15.036576    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:15.036672 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:15.036658    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:17.036434 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:17.036377    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:17.036434 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:17.036416    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:17.036988 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:17.036377    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:17.036988 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:17.036555    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:17.036988 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:17.036626    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:17.036988 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:17.036682    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:19.036600 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.036571    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:19.037189 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.036668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:19.037189 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.036691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:19.037189 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:19.036766    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:19.037189 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:19.036673    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:19.037189 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:19.036867    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:19.239167 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.238998    2573 generic.go:356] "Generic (PLEG): container finished" podID="1e5aaed7550f49767f81ba0dc1f58c32" containerID="64306d7b126eb2b2926f4642fdbfbb8252ee566c8f2ec6f532d9e8489721b5b4" exitCode=0
Sep 10 20:58:19.239341 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.239068    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal" event={"ID":"1e5aaed7550f49767f81ba0dc1f58c32","Type":"ContainerDied","Data":"64306d7b126eb2b2926f4642fdbfbb8252ee566c8f2ec6f532d9e8489721b5b4"}
Sep 10 20:58:19.240596 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.240569    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fk6mv" event={"ID":"2f6de03c-5454-4b85-be6e-d6cec7612e65","Type":"ContainerStarted","Data":"ff04615d61b3c9c4debb3501c645990e22a19fbd5b4ff8c13c1e8a9d813b8a07"}
Sep 10 20:58:19.242977 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.242447    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4psvv" event={"ID":"01ccbe4d-ba0b-4888-b17e-e9f340c2d548","Type":"ContainerStarted","Data":"adca19705b7ac967c772255c1c7eadb50f86cb1af0162baf9cd9c1b7f5f9fb57"}
Sep 10 20:58:19.246470 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.246439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tn5w" event={"ID":"4c221f57-edf1-4e02-a377-5c5ecb6bf30c","Type":"ContainerStarted","Data":"9efec2eb80c7cad6903f9b45157d77ae49393b187521287ecef5b183f897db20"}
Sep 10 20:58:19.247889 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.247868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bqsvr" event={"ID":"c103b925-1865-47bd-b5ff-5130a6442493","Type":"ContainerStarted","Data":"bf38ba1b9cd4f1f62f76cdc4f3b74618de4ed4d3fd9cf206b13fb5ffb9f8dd3d"}
Sep 10 20:58:19.249198 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.249172    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blzx5" event={"ID":"f7938aa9-84a2-4ea2-a2db-bad2cb530c10","Type":"ContainerStarted","Data":"b560c7fad5ad9dc17af8d7674c38eda27a25ad8e60b17c22d9106e2be2e3a323"}
Sep 10 20:58:19.250573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.250546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal" event={"ID":"4ee37362506138ee29eeccd68e40c0bf","Type":"ContainerStarted","Data":"4003d2fd159f08c08bb60f3000408c855ae97afed62148749011429e6a71cb18"}
Sep 10 20:58:19.253242 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253227    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 20:58:19.253587 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253570    2573 generic.go:356] "Generic (PLEG): container finished" podID="88948997-10ae-459b-bb46-4b7fa8705cf9" containerID="0132dd44e7c3979281f515d3c11c4ee5a3c4b03ccb4c6f3d99caa7ae59c80075" exitCode=1
Sep 10 20:58:19.253637 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"91e43587288be76f4dafcc6a8ddc2947a3b25a56028ebddb9fe6e6af717b7aae"}
Sep 10 20:58:19.253685 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"862c4b160620cb57b968c61b20bd2241890196a35eaf32903a57468fc3a4e43a"}
Sep 10 20:58:19.253727 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253707    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"315a020f22b6097334a3b9aa1cab3f919097f29a1cda32a4c9c46580286bedab"}
Sep 10 20:58:19.253763 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"ab62a64e79da5cb9d615688edc736e236d5a4ed836a7b394c082dbecde0aec22"}
Sep 10 20:58:19.253801 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253770    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerDied","Data":"0132dd44e7c3979281f515d3c11c4ee5a3c4b03ccb4c6f3d99caa7ae59c80075"}
Sep 10 20:58:19.253841 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.253804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"1a1b98578653b1199740db4e88c88a2ab18156c683cd4da12cf10c8b35d204b3"}
Sep 10 20:58:19.255044 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.255028    2573 generic.go:356] "Generic (PLEG): container finished" podID="17ea9f04-bab4-40c3-a21a-80e3dd44ecd9" containerID="6a525874a9e6a290ea3c36d7d4d1aafa09119112a05ba01809ffff49957bf7e6" exitCode=0
Sep 10 20:58:19.255101 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.255051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerDied","Data":"6a525874a9e6a290ea3c36d7d4d1aafa09119112a05ba01809ffff49957bf7e6"}
Sep 10 20:58:19.256602 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.256580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf" event={"ID":"f879ab19-b363-456c-af14-98ee53909f21","Type":"ContainerStarted","Data":"0846257eb7e7edddbcc64c6daa47fded27ba4ba5626a77478ac1880a7e04b103"}
Sep 10 20:58:19.257937 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.257895    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fk6mv" podStartSLOduration=1.929877452 podStartE2EDuration="21.257883785s" totalImagesPullingTime="19.328006333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.257635685 +0000 UTC m=+21.691465635" watchObservedRunningTime="2026-09-10 20:58:19.257883785 +0000 UTC m=+21.691713734"
Sep 10 20:58:19.272063 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.272009    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-blzx5" podStartSLOduration=2.417441834 podStartE2EDuration="21.271994436s" totalImagesPullingTime="18.854552602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.271599792 +0000 UTC m=+21.705429741" watchObservedRunningTime="2026-09-10 20:58:19.271994436 +0000 UTC m=+21.705824384"
Sep 10 20:58:19.284566 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.284522    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4tn5w" podStartSLOduration=2.411782486 podStartE2EDuration="21.284506692s" totalImagesPullingTime="18.872724206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.284416232 +0000 UTC m=+21.718246171" watchObservedRunningTime="2026-09-10 20:58:19.284506692 +0000 UTC m=+21.718336641"
Sep 10 20:58:19.297790 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.297690    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4psvv" podStartSLOduration=2.432787832 podStartE2EDuration="21.297673723s" totalImagesPullingTime="18.864885891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.297523227 +0000 UTC m=+21.731353176" watchObservedRunningTime="2026-09-10 20:58:19.297673723 +0000 UTC m=+21.731503672"
Sep 10 20:58:19.311720 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.311665    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-116.ec2.internal" podStartSLOduration=20.31164849 podStartE2EDuration="20.31164849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.311371426 +0000 UTC m=+21.745201389" watchObservedRunningTime="2026-09-10 20:58:19.31164849 +0000 UTC m=+21.745478439"
Sep 10 20:58:19.333238 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:19.333189    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bqsvr" podStartSLOduration=2.484907281 podStartE2EDuration="21.333175154s" totalImagesPullingTime="18.848267873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:19.333135362 +0000 UTC m=+21.766965317" watchObservedRunningTime="2026-09-10 20:58:19.333175154 +0000 UTC m=+21.767005104"
Sep 10 20:58:20.260577 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:20.260541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cz5x7" event={"ID":"7d09cae3-10ac-47fb-afb5-efcc4c54a7b3","Type":"ContainerStarted","Data":"3e984e21b1791627ea08413ca0378adec2050fdaa1b42588a20f2f123a0502d7"}
Sep 10 20:58:20.291997 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:20.291932    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cz5x7" podStartSLOduration=3.362707946 podStartE2EDuration="22.291911313s" totalImagesPullingTime="18.929203367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:20.291893166 +0000 UTC m=+22.725723118" watchObservedRunningTime="2026-09-10 20:58:20.291911313 +0000 UTC m=+22.725741262"
Sep 10 20:58:20.304531 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:20.304484    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:58:20.304933 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:20.304910    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:58:20.398702 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:20.398638    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 20:58:21.024499 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.024335    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T20:58:20.398661941Z","UUID":"e508cf48-a4ce-45f7-a558-8d466e97e865","Handler":null,"Name":"","Endpoint":""}
Sep 10 20:58:21.026248 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.026226    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 20:58:21.026370 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.026258    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 20:58:21.036779 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.036751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:21.036939 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.036792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:21.036939 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.036792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:21.036939 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:21.036871    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:21.037104 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:21.036985    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:21.037104 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:21.037057    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:21.265501 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.265233    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf" event={"ID":"f879ab19-b363-456c-af14-98ee53909f21","Type":"ContainerStarted","Data":"cfa1e9190db8fe2ab1ac0fa79bd052efd16e43c2e9a9e6d77ecf61feeb54571f"}
Sep 10 20:58:21.267337 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.267303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal" event={"ID":"1e5aaed7550f49767f81ba0dc1f58c32","Type":"ContainerStarted","Data":"37b69658e45356933d334313609f6be56f49fc10febbb2a3031a5192e599a499"}
Sep 10 20:58:21.695276 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.695242    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:58:21.695978 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.695958    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-blzx5"
Sep 10 20:58:21.710174 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:21.710128    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-116.ec2.internal" podStartSLOduration=22.710110021 podStartE2EDuration="22.710110021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:21.283177899 +0000 UTC m=+23.717007848" watchObservedRunningTime="2026-09-10 20:58:21.710110021 +0000 UTC m=+24.143939970"
Sep 10 20:58:22.273227 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:22.273196    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 20:58:22.273712 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:22.273683    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"dc55ed845d11d649ad95cd2316805d09c67283f3ef8f3a28a6c997d0ac3266e1"}
Sep 10 20:58:22.276150 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:22.276120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf" event={"ID":"f879ab19-b363-456c-af14-98ee53909f21","Type":"ContainerStarted","Data":"941514b5fa5c706a7aa12dbebb8bece63d80d42587f19e280a086226a1e11a37"}
Sep 10 20:58:22.293498 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:22.293438    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrqgf" podStartSLOduration=3.064472554 podStartE2EDuration="24.293416728s" totalImagesPullingTime="21.228944174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:22.293333229 +0000 UTC m=+24.727163177" watchObservedRunningTime="2026-09-10 20:58:22.293416728 +0000 UTC m=+24.727246686"
Sep 10 20:58:23.037162 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:23.037116    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:23.037162 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:23.037150    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:23.037432 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:23.037160    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:23.037432 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:23.037240    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:23.037432 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:23.037310    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:23.037578 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:23.037454    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:24.283039 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.282844    2573 generic.go:356] "Generic (PLEG): container finished" podID="17ea9f04-bab4-40c3-a21a-80e3dd44ecd9" containerID="1c1f82081b1e46f333d062bbd42569f6ed23fbe7283a1db8f39b738781eb95f8" exitCode=0
Sep 10 20:58:24.283562 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.282939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerDied","Data":"1c1f82081b1e46f333d062bbd42569f6ed23fbe7283a1db8f39b738781eb95f8"}
Sep 10 20:58:24.287073 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.287053    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 20:58:24.287438 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.287408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"de7c71c8b32ea61c70d90a5a6c62011af9144dedcd018321883db70b9bdce540"}
Sep 10 20:58:24.287716 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.287700    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:58:24.287854 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.287840    2573 scope.go:117] "RemoveContainer" containerID="0132dd44e7c3979281f515d3c11c4ee5a3c4b03ccb4c6f3d99caa7ae59c80075"
Sep 10 20:58:24.303747 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:24.303728    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:58:25.036670 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.036626    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:25.036943 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.036635    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:25.036943 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.036636    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:25.036943 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:25.036835    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:25.036943 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:25.036774    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:25.036943 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:25.036886    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:25.294582 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.294522    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 20:58:25.295303 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.294914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" event={"ID":"88948997-10ae-459b-bb46-4b7fa8705cf9","Type":"ContainerStarted","Data":"05dd4266c7f82a4aa7f41cdb61cdcf381503a1c9af05def841838b956be1ff43"}
Sep 10 20:58:25.295303 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.295247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:58:25.295394 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.295317    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:58:25.315035 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.315007    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:58:25.323186 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.323127    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh" podStartSLOduration=8.394896894 podStartE2EDuration="27.323105649s" totalImagesPullingTime="18.928208755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:25.32160834 +0000 UTC m=+27.755438292" watchObservedRunningTime="2026-09-10 20:58:25.323105649 +0000 UTC m=+27.756935597"
Sep 10 20:58:25.335284 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.335242    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g2g24"]
Sep 10 20:58:25.335479 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.335382    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:25.335549 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:25.335527    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:25.335938 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.335905    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v8pqm"]
Sep 10 20:58:25.336036 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.336002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:25.336135 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:25.336116    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:25.337604 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.337582    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54wrf"]
Sep 10 20:58:25.337709 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:25.337684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:25.337809 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:25.337783    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:26.299694 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:26.299660    2573 generic.go:356] "Generic (PLEG): container finished" podID="17ea9f04-bab4-40c3-a21a-80e3dd44ecd9" containerID="49af1cc7ecc6cd3a43d2f94462e79d9d4d2f94be360b08c5aac509d32e7f2ff8" exitCode=0
Sep 10 20:58:26.300178 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:26.299725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerDied","Data":"49af1cc7ecc6cd3a43d2f94462e79d9d4d2f94be360b08c5aac509d32e7f2ff8"}
Sep 10 20:58:27.037634 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:27.037363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:27.037634 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:27.037372    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:27.037845 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:27.037654    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:27.037845 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:27.037425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:27.037845 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:27.037739    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:27.037845 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:27.037797    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:28.307178 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:28.307143    2573 generic.go:356] "Generic (PLEG): container finished" podID="17ea9f04-bab4-40c3-a21a-80e3dd44ecd9" containerID="e0ce2cb25a6f3e890f14a3c5b75d239aeabef2a2c3f6ec5df9ea16388ba83254" exitCode=0
Sep 10 20:58:28.307578 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:28.307184    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerDied","Data":"e0ce2cb25a6f3e890f14a3c5b75d239aeabef2a2c3f6ec5df9ea16388ba83254"}
Sep 10 20:58:29.036797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:29.036755    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:29.036797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:29.036786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:29.036797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:29.036767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:29.037124 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:29.036891    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:29.037124 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:29.036983    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:29.037238 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:29.037151    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:30.378974 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:30.378924    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.468176 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:30.468135    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:30.703668 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:30.703569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:30.703828 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.703809    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:30.703906 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.703893    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret podName:40579060-85b2-4b38-9eb7-2a97dfb3780b nodeName:}" failed. No retries permitted until 2026-09-10 20:59:02.703870134 +0000 UTC m=+65.137700074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret") pod "global-pull-secret-syncer-g2g24" (UID: "40579060-85b2-4b38-9eb7-2a97dfb3780b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:58:30.804388 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:30.804355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:30.804558 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:30.804427    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:30.804558 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.804544    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:58:30.804558 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.804544    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:30.804655 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.804635    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs podName:2404ec37-e8a7-4eb2-b841-a20815a2464a nodeName:}" failed. No retries permitted until 2026-09-10 20:59:02.804613013 +0000 UTC m=+65.238442960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs") pod "network-metrics-daemon-v8pqm" (UID: "2404ec37-e8a7-4eb2-b841-a20815a2464a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:58:30.804655 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.804559    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:58:30.804727 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.804658    2573 projected.go:196] Error preparing data for projected volume kube-api-access-4dsdh for pod openshift-network-diagnostics/network-check-target-54wrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:30.804727 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:30.804695    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh podName:d636cf86-f3ef-445e-b2a0-7ed4762a3444 nodeName:}" failed. No retries permitted until 2026-09-10 20:59:02.804683863 +0000 UTC m=+65.238513804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dsdh" (UniqueName: "kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh") pod "network-check-target-54wrf" (UID: "d636cf86-f3ef-445e-b2a0-7ed4762a3444") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:58:30.859709 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:30.859671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.036558 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.036471    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:31.036558 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.036497    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:31.036558 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.036497    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:31.036781 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:31.036618    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2g24" podUID="40579060-85b2-4b38-9eb7-2a97dfb3780b"
Sep 10 20:58:31.036781 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:31.036737    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8pqm" podUID="2404ec37-e8a7-4eb2-b841-a20815a2464a"
Sep 10 20:58:31.036846 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:31.036797    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-54wrf" podUID="d636cf86-f3ef-445e-b2a0-7ed4762a3444"
Sep 10 20:58:31.043596 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.043555    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.141376 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.141339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.195669 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.195635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.353961 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.353926    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-116.ec2.internal" event="NodeReady"
Sep 10 20:58:31.354126 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.354055    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 20:58:31.397880 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.397832    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p4kv6"]
Sep 10 20:58:31.400538 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.400514    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.401142 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.401119    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hbtl5"]
Sep 10 20:58:31.402838 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.402762    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.402985 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.402963    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 20:58:31.403276 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.403246    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 20:58:31.403355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.403336    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56bmz\""
Sep 10 20:58:31.405297 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.405170    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 20:58:31.405297 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.405194    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jcxqf\""
Sep 10 20:58:31.405297 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.405212    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 20:58:31.405297 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.405272    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 20:58:31.411121 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.411101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p4kv6"]
Sep 10 20:58:31.414673 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.414647    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbtl5"]
Sep 10 20:58:31.509483 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.509441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31902c8e-2222-4b0e-8adf-7796567b1f9e-tmp-dir\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.509660 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.509545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31902c8e-2222-4b0e-8adf-7796567b1f9e-config-volume\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.509660 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.509577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd-cert\") pod \"ingress-canary-hbtl5\" (UID: \"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd\") " pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.509755 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.509668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbthm\" (UniqueName: \"kubernetes.io/projected/40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd-kube-api-access-pbthm\") pod \"ingress-canary-hbtl5\" (UID: \"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd\") " pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.509755 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.509710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.509755 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.509744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb282\" (UniqueName: \"kubernetes.io/projected/31902c8e-2222-4b0e-8adf-7796567b1f9e-kube-api-access-fb282\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.610267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31902c8e-2222-4b0e-8adf-7796567b1f9e-config-volume\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.610267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd-cert\") pod \"ingress-canary-hbtl5\" (UID: \"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd\") " pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.610497 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbthm\" (UniqueName: \"kubernetes.io/projected/40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd-kube-api-access-pbthm\") pod \"ingress-canary-hbtl5\" (UID: \"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd\") " pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.610497 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.610497 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb282\" (UniqueName: \"kubernetes.io/projected/31902c8e-2222-4b0e-8adf-7796567b1f9e-kube-api-access-fb282\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.610497 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31902c8e-2222-4b0e-8adf-7796567b1f9e-tmp-dir\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.610677 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:31.610495    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:31.610677 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:31.610565    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls podName:31902c8e-2222-4b0e-8adf-7796567b1f9e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:32.110544984 +0000 UTC m=+34.544374934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls") pod "dns-default-p4kv6" (UID: "31902c8e-2222-4b0e-8adf-7796567b1f9e") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:31.610772 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31902c8e-2222-4b0e-8adf-7796567b1f9e-tmp-dir\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.610874 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.610849    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31902c8e-2222-4b0e-8adf-7796567b1f9e-config-volume\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.615425 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.615382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd-cert\") pod \"ingress-canary-hbtl5\" (UID: \"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd\") " pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.621448 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.621423    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbthm\" (UniqueName: \"kubernetes.io/projected/40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd-kube-api-access-pbthm\") pod \"ingress-canary-hbtl5\" (UID: \"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd\") " pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:31.623704 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.623677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb282\" (UniqueName: \"kubernetes.io/projected/31902c8e-2222-4b0e-8adf-7796567b1f9e-kube-api-access-fb282\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:31.624143 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.624108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.679110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.679078    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:31.719078 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:31.719041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbtl5"
Sep 10 20:58:32.114432 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:32.114296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:32.114631 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:32.114445    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:32.114631 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:32.114529    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls podName:31902c8e-2222-4b0e-8adf-7796567b1f9e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:33.114508337 +0000 UTC m=+35.548338269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls") pod "dns-default-p4kv6" (UID: "31902c8e-2222-4b0e-8adf-7796567b1f9e") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:32.428970 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:32.428805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:32.479175 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:32.479144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:32.554638 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:32.554609    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbtl5"]
Sep 10 20:58:32.558103 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:58:32.558080    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c1025e_87ce_4eef_8f1b_b3f1fe00b0cd.slice/crio-ba559d9fe68603db94fa3e7774561986f980072ac016e61e7405e67f71a1bd33 WatchSource:0}: Error finding container ba559d9fe68603db94fa3e7774561986f980072ac016e61e7405e67f71a1bd33: Status 404 returned error can't find the container with id ba559d9fe68603db94fa3e7774561986f980072ac016e61e7405e67f71a1bd33
Sep 10 20:58:33.036916 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.036888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:58:33.037106 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.036923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:58:33.037106 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.036924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:58:33.039377 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.039353    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:58:33.040346 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.040325    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:58:33.040486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.040353    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6p7f\""
Sep 10 20:58:33.040486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.040380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbskf\""
Sep 10 20:58:33.040486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.040329    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:58:33.040486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.040442    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:58:33.121556 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.121526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:33.121738 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:33.121649    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:33.121738 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:33.121718    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls podName:31902c8e-2222-4b0e-8adf-7796567b1f9e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:35.121699626 +0000 UTC m=+37.555529558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls") pod "dns-default-p4kv6" (UID: "31902c8e-2222-4b0e-8adf-7796567b1f9e") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:33.323951 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.323918    2573 generic.go:356] "Generic (PLEG): container finished" podID="17ea9f04-bab4-40c3-a21a-80e3dd44ecd9" containerID="18c6444de7ad99ccd98bc6d11b19062fa1e24ecc9d049c016e8838da28f14b95" exitCode=0
Sep 10 20:58:33.324146 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.324004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerDied","Data":"18c6444de7ad99ccd98bc6d11b19062fa1e24ecc9d049c016e8838da28f14b95"}
Sep 10 20:58:33.326210 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.326144    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbtl5" event={"ID":"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd","Type":"ContainerStarted","Data":"ba559d9fe68603db94fa3e7774561986f980072ac016e61e7405e67f71a1bd33"}
Sep 10 20:58:33.476557 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.476510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:33.527578 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:33.527543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:34.173732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:34.173698    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:34.333043 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:34.333012    2573 generic.go:356] "Generic (PLEG): container finished" podID="17ea9f04-bab4-40c3-a21a-80e3dd44ecd9" containerID="3a5e6568a4311b51f3c6b2e603c2cb86e051c287f065ec72264edb63c1f5f96c" exitCode=0
Sep 10 20:58:34.333216 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:34.333067    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerDied","Data":"3a5e6568a4311b51f3c6b2e603c2cb86e051c287f065ec72264edb63c1f5f96c"}
Sep 10 20:58:35.138813 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.138577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:35.139272 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:35.138731    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:35.139272 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:35.138885    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls podName:31902c8e-2222-4b0e-8adf-7796567b1f9e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:39.138863594 +0000 UTC m=+41.572693536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls") pod "dns-default-p4kv6" (UID: "31902c8e-2222-4b0e-8adf-7796567b1f9e") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:35.339535 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.339495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" event={"ID":"17ea9f04-bab4-40c3-a21a-80e3dd44ecd9","Type":"ContainerStarted","Data":"51485d3795bf6ca07f39ceb5bb2bef278a08787946f61b5ca0f5e6f13cb20650"}
Sep 10 20:58:35.341077 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.341051    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbtl5" event={"ID":"40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd","Type":"ContainerStarted","Data":"f6990c1cc88d9e0d2ad6c12dfa735da1b709b716ba23f8b082523d504f20e426"}
Sep 10 20:58:35.360346 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.360298    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c8hq8" podStartSLOduration=8.035926433 podStartE2EDuration="37.360282722s" totalImagesPullingTime="29.324356289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:35.358875732 +0000 UTC m=+37.792705685" watchObservedRunningTime="2026-09-10 20:58:35.360282722 +0000 UTC m=+37.794112670"
Sep 10 20:58:35.374258 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.374197    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hbtl5" podStartSLOduration=2.235017606 podStartE2EDuration="4.374180421s" totalImagesPullingTime="2.139162815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:35.373496646 +0000 UTC m=+37.807326596" watchObservedRunningTime="2026-09-10 20:58:35.374180421 +0000 UTC m=+37.808010370"
Sep 10 20:58:35.456662 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.456629    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:35.509388 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.509352    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:35.919148 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:35.919118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:36.022146 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.022110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:36.360514 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.360484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:36.950945 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.950910    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"]
Sep 10 20:58:36.951655 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.951633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:36.970949 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.970925    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"]
Sep 10 20:58:36.971061 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.971044    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"
Sep 10 20:58:36.973279 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.973261    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 20:58:36.974160 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.974147    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pzvwd\""
Sep 10 20:58:36.974160 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:36.974156    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 20:58:37.051365 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.051333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgt4k\" (UniqueName: \"kubernetes.io/projected/0fc241b8-ff4a-4be7-bc3b-76d683faf82f-kube-api-access-dgt4k\") pod \"migrator-8b4d697c5-64rg8\" (UID: \"0fc241b8-ff4a-4be7-bc3b-76d683faf82f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"
Sep 10 20:58:37.051922 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.051901    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:37.145815 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.145784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:37.151913 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.151894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgt4k\" (UniqueName: \"kubernetes.io/projected/0fc241b8-ff4a-4be7-bc3b-76d683faf82f-kube-api-access-dgt4k\") pod \"migrator-8b4d697c5-64rg8\" (UID: \"0fc241b8-ff4a-4be7-bc3b-76d683faf82f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"
Sep 10 20:58:37.160394 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.160365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgt4k\" (UniqueName: \"kubernetes.io/projected/0fc241b8-ff4a-4be7-bc3b-76d683faf82f-kube-api-access-dgt4k\") pod \"migrator-8b4d697c5-64rg8\" (UID: \"0fc241b8-ff4a-4be7-bc3b-76d683faf82f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"
Sep 10 20:58:37.181543 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.181508    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nm8v4"]
Sep 10 20:58:37.198816 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.198785    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nm8v4"]
Sep 10 20:58:37.198950 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.198889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.201426 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.201349    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 20:58:37.201605 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.201426    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 20:58:37.201605 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.201438    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2prl\""
Sep 10 20:58:37.201605 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.201469    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 20:58:37.201605 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.201465    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 20:58:37.227822 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.226316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:37.280039 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.280006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"
Sep 10 20:58:37.352858 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.352831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.353000 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.352986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.353091 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.353082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5908d2b-16f9-48b6-bf6e-cbce61292c90-data-volume\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.353186 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.353177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5908d2b-16f9-48b6-bf6e-cbce61292c90-crio-socket\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.353302 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.353291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxtsf\" (UniqueName: \"kubernetes.io/projected/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-api-access-xxtsf\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.454560 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.454560 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5908d2b-16f9-48b6-bf6e-cbce61292c90-data-volume\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.454560 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454536    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5908d2b-16f9-48b6-bf6e-cbce61292c90-crio-socket\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454638    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxtsf\" (UniqueName: \"kubernetes.io/projected/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-api-access-xxtsf\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.454706    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5908d2b-16f9-48b6-bf6e-cbce61292c90-crio-socket\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.454762    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.454794    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:37.954779002 +0000 UTC m=+40.388608949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.454826    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:37.95481109 +0000 UTC m=+40.388641031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.455076 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.454920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5908d2b-16f9-48b6-bf6e-cbce61292c90-data-volume\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.463233 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.463202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxtsf\" (UniqueName: \"kubernetes.io/projected/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-api-access-xxtsf\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.567276 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.567248    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8"]
Sep 10 20:58:37.570236 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:58:37.570212    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc241b8_ff4a_4be7_bc3b_76d683faf82f.slice/crio-38e315b293cc031b8a0e40cd176d6a787b2b9e209691f58f8ded94581a102be7 WatchSource:0}: Error finding container 38e315b293cc031b8a0e40cd176d6a787b2b9e209691f58f8ded94581a102be7: Status 404 returned error can't find the container with id 38e315b293cc031b8a0e40cd176d6a787b2b9e209691f58f8ded94581a102be7
Sep 10 20:58:37.832520 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.832488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:37.890380 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.890354    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:37.958931 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.958891    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.958931 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:37.958930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:37.959118 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.959016    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.959118 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.959038    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:37.959118 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.959072    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:38.959058818 +0000 UTC m=+41.392888744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:37.959118 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:37.959090    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:38.959077025 +0000 UTC m=+41.392906978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:38.351001 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:38.350961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8" event={"ID":"0fc241b8-ff4a-4be7-bc3b-76d683faf82f","Type":"ContainerStarted","Data":"38e315b293cc031b8a0e40cd176d6a787b2b9e209691f58f8ded94581a102be7"}
Sep 10 20:58:38.965913 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:38.965873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:38.965913 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:38.965914    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:38.966312 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:38.966004    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:38.966312 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:38.966022    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:38.966312 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:38.966065    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:40.966048388 +0000 UTC m=+43.399878329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:38.966312 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:38.966079    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:40.966072956 +0000 UTC m=+43.399902883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:39.167816 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:39.167784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:39.167983 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:39.167959    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:39.168047 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:39.168036    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls podName:31902c8e-2222-4b0e-8adf-7796567b1f9e nodeName:}" failed. No retries permitted until 2026-09-10 20:58:47.168016068 +0000 UTC m=+49.601846011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls") pod "dns-default-p4kv6" (UID: "31902c8e-2222-4b0e-8adf-7796567b1f9e") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:39.354863 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:39.354833    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8" event={"ID":"0fc241b8-ff4a-4be7-bc3b-76d683faf82f","Type":"ContainerStarted","Data":"ed2c2cb60a9e6c1fd0653a04a74125c55f44dfcd1a24069bebc1de0e25813c48"}
Sep 10 20:58:39.448022 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:39.447987    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:39.507093 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:39.507008    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:39.730791 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:39.730763    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tn5w_4c221f57-edf1-4e02-a377-5c5ecb6bf30c/dns-node-resolver/0.log"
Sep 10 20:58:40.359263 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:40.359226    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8" event={"ID":"0fc241b8-ff4a-4be7-bc3b-76d683faf82f","Type":"ContainerStarted","Data":"08da09b51c957f02be99a11c973ca07a94284f3e6907a1fb9b88ec85488edd26"}
Sep 10 20:58:40.382754 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:40.382699    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-64rg8" podStartSLOduration=2.780828528 podStartE2EDuration="4.38268429s" totalImagesPullingTime="1.601855762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:40.381786446 +0000 UTC m=+42.815616395" watchObservedRunningTime="2026-09-10 20:58:40.38268429 +0000 UTC m=+42.816514240"
Sep 10 20:58:40.732070 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:40.731990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4psvv_01ccbe4d-ba0b-4888-b17e-e9f340c2d548/node-ca/0.log"
Sep 10 20:58:40.983423 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:40.983320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:40.983423 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:40.983364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:40.983775 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:40.983468    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:58:40.983775 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:40.983515    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:40.983775 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:40.983536    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:44.983520683 +0000 UTC m=+47.417350624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : configmap "kube-rbac-proxy" not found
Sep 10 20:58:40.983775 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:40.983597    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:44.983578637 +0000 UTC m=+47.417408577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:41.165307 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:41.165254    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:41.930721 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:41.930694    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbtl5_40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd/serve-healthcheck-canary/0.log"
Sep 10 20:58:42.130704 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:42.130674    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-64rg8_0fc241b8-ff4a-4be7-bc3b-76d683faf82f/migrator/0.log"
Sep 10 20:58:42.330572 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:42.330548    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-64rg8_0fc241b8-ff4a-4be7-bc3b-76d683faf82f/graceful-termination/0.log"
Sep 10 20:58:43.202015 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:43.201983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:43.577475 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:43.577446    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:44.665168 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:44.665136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:44.779665 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:44.779632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:44.866578 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:44.866549    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:44.971326 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:44.971247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:45.013531 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:45.013503    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:45.013643 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:45.013541    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:45.013680 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:45.013661    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:45.013759 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:45.013746    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls podName:f5908d2b-16f9-48b6-bf6e-cbce61292c90 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:53.013725461 +0000 UTC m=+55.447555388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm8v4" (UID: "f5908d2b-16f9-48b6-bf6e-cbce61292c90") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:58:45.014145 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:45.014129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5908d2b-16f9-48b6-bf6e-cbce61292c90-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:45.160973 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:45.160938    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:45.366624 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:45.366588    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:46.160881 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:46.160856    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:46.561863 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:46.561785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:46.961086 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:46.961053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:47.161877 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:47.161838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:47.227225 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:47.227157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:58:47.227353 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:47.227330    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:58:47.227448 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:58:47.227437    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls podName:31902c8e-2222-4b0e-8adf-7796567b1f9e nodeName:}" failed. No retries permitted until 2026-09-10 20:59:03.227395354 +0000 UTC m=+65.661225295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls") pod "dns-default-p4kv6" (UID: "31902c8e-2222-4b0e-8adf-7796567b1f9e") : secret "dns-default-metrics-tls" not found
Sep 10 20:58:47.761568 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:47.761534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.250641 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.250601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.361865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.361836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.426349 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.426317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.493556 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.493523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.594894 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.594863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.647096 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.647067    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.761000 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.760967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:48.957441 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:48.957347    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:49.009439 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:49.009410    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:50.164393 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:50.164353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:50.361265 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:50.361231    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:50.554724 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:50.554636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:50.757368 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:50.757331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:50.942300 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:50.942273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:50.994361 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:50.994331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:51.963350 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:51.963318    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.361532 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:52.361497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.555334 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:52.555298    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.762318 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:52.762241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:52.959003 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:52.958972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:53.074687 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.074658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:53.076933 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.076902    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5908d2b-16f9-48b6-bf6e-cbce61292c90-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm8v4\" (UID: \"f5908d2b-16f9-48b6-bf6e-cbce61292c90\") " pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:53.108032 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.108003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nm8v4"
Sep 10 20:58:53.374735 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.374592    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nm8v4"]
Sep 10 20:58:53.377143 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:58:53.377119    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5908d2b_16f9_48b6_bf6e_cbce61292c90.slice/crio-c17a394d16ba98022974998fce64d381585a0ce6790f1c866da1a8c8693c98b2 WatchSource:0}: Error finding container c17a394d16ba98022974998fce64d381585a0ce6790f1c866da1a8c8693c98b2: Status 404 returned error can't find the container with id c17a394d16ba98022974998fce64d381585a0ce6790f1c866da1a8c8693c98b2
Sep 10 20:58:53.390823 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.390787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm8v4" event={"ID":"f5908d2b-16f9-48b6-bf6e-cbce61292c90","Type":"ContainerStarted","Data":"c17a394d16ba98022974998fce64d381585a0ce6790f1c866da1a8c8693c98b2"}
Sep 10 20:58:53.543945 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.543910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:53.963878 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:53.963825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:54.355663 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:54.355619    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:54.394871 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:54.394835    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm8v4" event={"ID":"f5908d2b-16f9-48b6-bf6e-cbce61292c90","Type":"ContainerStarted","Data":"0f4039c7d515168392bf066d8d645c0a2edaa442a0b83095feb2117368c679ef"}
Sep 10 20:58:54.395037 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:54.394893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm8v4" event={"ID":"f5908d2b-16f9-48b6-bf6e-cbce61292c90","Type":"ContainerStarted","Data":"83822002effa4047c561186c3097e67135e05b068017d8b3df59b014d8808433"}
Sep 10 20:58:54.554942 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:54.554900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:54.772795 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:54.772699    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:54.963909 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:54.963871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:55.359000 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:55.358972    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:58:56.402667 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:56.402635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm8v4" event={"ID":"f5908d2b-16f9-48b6-bf6e-cbce61292c90","Type":"ContainerStarted","Data":"b28845b375c0b753f52031a9dbe93ca4578f17891c08b1e62c76956ff93da9aa"}
Sep 10 20:58:56.434972 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:56.434915    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nm8v4" podStartSLOduration=17.475246152 podStartE2EDuration="19.434895093s" totalImagesPullingTime="1.959648941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:58:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:56.433352488 +0000 UTC m=+58.867182427" watchObservedRunningTime="2026-09-10 20:58:56.434895093 +0000 UTC m=+58.868725041"
Sep 10 20:58:57.323249 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:58:57.323217    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xx4mh"
Sep 10 20:59:01.200483 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.200444    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"]
Sep 10 20:59:01.202924 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.202897    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.205855 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.205830    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 20:59:01.206693 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.206674    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 20:59:01.206865 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.206850    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 20:59:01.206927 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.206900    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 20:59:01.206969 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.206902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gq9gf\""
Sep 10 20:59:01.217946 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.217918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"]
Sep 10 20:59:01.237961 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.237927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a20d09a3-2d63-4816-ba40-53bfe864f1ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c967b87d-csv9p\" (UID: \"a20d09a3-2d63-4816-ba40-53bfe864f1ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.237961 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.237962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnpvg\" (UniqueName: \"kubernetes.io/projected/a20d09a3-2d63-4816-ba40-53bfe864f1ca-kube-api-access-tnpvg\") pod \"managed-serviceaccount-addon-agent-59c967b87d-csv9p\" (UID: \"a20d09a3-2d63-4816-ba40-53bfe864f1ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.254486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.254454    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.308369 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.308337    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-698ffb8ff8-qpbb7"]
Sep 10 20:59:01.310346 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.310328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.312630 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.312605    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 20:59:01.312630 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.312627    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-88l8n\""
Sep 10 20:59:01.312804 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.312610    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 20:59:01.312804 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.312759    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 20:59:01.320698 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.320679    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 20:59:01.329358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.329329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-698ffb8ff8-qpbb7"]
Sep 10 20:59:01.338534 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a20d09a3-2d63-4816-ba40-53bfe864f1ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c967b87d-csv9p\" (UID: \"a20d09a3-2d63-4816-ba40-53bfe864f1ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.338534 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnpvg\" (UniqueName: \"kubernetes.io/projected/a20d09a3-2d63-4816-ba40-53bfe864f1ca-kube-api-access-tnpvg\") pod \"managed-serviceaccount-addon-agent-59c967b87d-csv9p\" (UID: \"a20d09a3-2d63-4816-ba40-53bfe864f1ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.338700 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b549803b-6180-42e3-83f7-9dc04a2732bc-ca-trust-extracted\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338700 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b549803b-6180-42e3-83f7-9dc04a2732bc-registry-certificates\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338700 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b549803b-6180-42e3-83f7-9dc04a2732bc-image-registry-private-configuration\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338806 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-registry-tls\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338896 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b549803b-6180-42e3-83f7-9dc04a2732bc-installation-pull-secrets\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338936 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5wsp\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-kube-api-access-x5wsp\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338936 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b549803b-6180-42e3-83f7-9dc04a2732bc-trusted-ca\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.338936 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.338932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-bound-sa-token\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.341337 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.341313    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a20d09a3-2d63-4816-ba40-53bfe864f1ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c967b87d-csv9p\" (UID: \"a20d09a3-2d63-4816-ba40-53bfe864f1ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.352811 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.352783    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnpvg\" (UniqueName: \"kubernetes.io/projected/a20d09a3-2d63-4816-ba40-53bfe864f1ca-kube-api-access-tnpvg\") pod \"managed-serviceaccount-addon-agent-59c967b87d-csv9p\" (UID: \"a20d09a3-2d63-4816-ba40-53bfe864f1ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.365793 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.365760    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.439885 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.439849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-registry-tls\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.439885 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.439890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b549803b-6180-42e3-83f7-9dc04a2732bc-installation-pull-secrets\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.439928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5wsp\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-kube-api-access-x5wsp\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.439953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b549803b-6180-42e3-83f7-9dc04a2732bc-trusted-ca\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.439983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-bound-sa-token\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.440036    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b549803b-6180-42e3-83f7-9dc04a2732bc-ca-trust-extracted\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.440059    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b549803b-6180-42e3-83f7-9dc04a2732bc-registry-certificates\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.440084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b549803b-6180-42e3-83f7-9dc04a2732bc-image-registry-private-configuration\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.440597 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.440564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b549803b-6180-42e3-83f7-9dc04a2732bc-ca-trust-extracted\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.441052 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.441028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b549803b-6180-42e3-83f7-9dc04a2732bc-trusted-ca\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.441128 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.441108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b549803b-6180-42e3-83f7-9dc04a2732bc-registry-certificates\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.442734 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.442701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b549803b-6180-42e3-83f7-9dc04a2732bc-installation-pull-secrets\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.442964 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.442947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b549803b-6180-42e3-83f7-9dc04a2732bc-image-registry-private-configuration\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.443091 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.443073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-registry-tls\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.448915 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.448895    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-bound-sa-token\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.449110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.449094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5wsp\" (UniqueName: \"kubernetes.io/projected/b549803b-6180-42e3-83f7-9dc04a2732bc-kube-api-access-x5wsp\") pod \"image-registry-698ffb8ff8-qpbb7\" (UID: \"b549803b-6180-42e3-83f7-9dc04a2732bc\") " pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.465030 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.464945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.522573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.522543    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"
Sep 10 20:59:01.610362 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.610336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.620338 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.620309    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:01.709803 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.709769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:01.792998 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.792920    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p"]
Sep 10 20:59:01.796073 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:01.796041    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda20d09a3_2d63_4816_ba40_53bfe864f1ca.slice/crio-a26585b06b3d62e7f7a5b9b223451b8fb8b20db1c0af7be71b034b1da3185e39 WatchSource:0}: Error finding container a26585b06b3d62e7f7a5b9b223451b8fb8b20db1c0af7be71b034b1da3185e39: Status 404 returned error can't find the container with id a26585b06b3d62e7f7a5b9b223451b8fb8b20db1c0af7be71b034b1da3185e39
Sep 10 20:59:01.888764 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:01.888733    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-698ffb8ff8-qpbb7"]
Sep 10 20:59:01.891705 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:01.891680    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb549803b_6180_42e3_83f7_9dc04a2732bc.slice/crio-0ad21c82c0b6315e4eeba83591a6c9771c2a78f39ea7389091ba687b74588089 WatchSource:0}: Error finding container 0ad21c82c0b6315e4eeba83591a6c9771c2a78f39ea7389091ba687b74588089: Status 404 returned error can't find the container with id 0ad21c82c0b6315e4eeba83591a6c9771c2a78f39ea7389091ba687b74588089
Sep 10 20:59:02.424943 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.424905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p" event={"ID":"a20d09a3-2d63-4816-ba40-53bfe864f1ca","Type":"ContainerStarted","Data":"a26585b06b3d62e7f7a5b9b223451b8fb8b20db1c0af7be71b034b1da3185e39"}
Sep 10 20:59:02.427441 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.427387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7" event={"ID":"b549803b-6180-42e3-83f7-9dc04a2732bc","Type":"ContainerStarted","Data":"8431599f5c89f79ae929a536461b4e4ae37655cdc61b8b20da77116baaaffeaa"}
Sep 10 20:59:02.427597 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.427464    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7" event={"ID":"b549803b-6180-42e3-83f7-9dc04a2732bc","Type":"ContainerStarted","Data":"0ad21c82c0b6315e4eeba83591a6c9771c2a78f39ea7389091ba687b74588089"}
Sep 10 20:59:02.427597 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.427577    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:02.448033 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.447974    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7" podStartSLOduration=1.447954603 podStartE2EDuration="1.447954603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:02.447266803 +0000 UTC m=+64.881096752" watchObservedRunningTime="2026-09-10 20:59:02.447954603 +0000 UTC m=+64.881784551"
Sep 10 20:59:02.586890 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.586854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:02.750430 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.750326    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:59:02.753152 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.753125    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:59:02.764119 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.764094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40579060-85b2-4b38-9eb7-2a97dfb3780b-original-pull-secret\") pod \"global-pull-secret-syncer-g2g24\" (UID: \"40579060-85b2-4b38-9eb7-2a97dfb3780b\") " pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:59:02.851644 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.851602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:59:02.851834 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.851726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:59:02.854377 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.854170    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:59:02.854377 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.854193    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:59:02.864368 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.864218    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:59:02.867253 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.867227    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2404ec37-e8a7-4eb2-b841-a20815a2464a-metrics-certs\") pod \"network-metrics-daemon-v8pqm\" (UID: \"2404ec37-e8a7-4eb2-b841-a20815a2464a\") " pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:59:02.875975 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.875947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dsdh\" (UniqueName: \"kubernetes.io/projected/d636cf86-f3ef-445e-b2a0-7ed4762a3444-kube-api-access-4dsdh\") pod \"network-check-target-54wrf\" (UID: \"d636cf86-f3ef-445e-b2a0-7ed4762a3444\") " pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:59:02.980703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:02.980673    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:03.050888 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.050817    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbskf\""
Sep 10 20:59:03.056713 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.056693    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2g24"
Sep 10 20:59:03.059830 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.059813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:59:03.065854 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.065838    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6p7f\""
Sep 10 20:59:03.074929 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.074909    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8pqm"
Sep 10 20:59:03.080647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.080620    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:03.255262 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.255225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:59:03.257758 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.257734    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31902c8e-2222-4b0e-8adf-7796567b1f9e-metrics-tls\") pod \"dns-default-p4kv6\" (UID: \"31902c8e-2222-4b0e-8adf-7796567b1f9e\") " pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:59:03.477858 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.477829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:03.515034 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.515001    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-56bmz\""
Sep 10 20:59:03.522888 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.522864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:59:03.531912 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:03.531879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.301890 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.301581    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.371127 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.371088    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.475748 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.475715    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.498625 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.498587    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"]
Sep 10 20:59:04.518188 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.518093    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"]
Sep 10 20:59:04.518359 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.518222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:04.520733 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.520711    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 20:59:04.520863 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.520742    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hd79t\""
Sep 10 20:59:04.536144 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.536116    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-54wrf"]
Sep 10 20:59:04.546578 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.546499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p4kv6"]
Sep 10 20:59:04.547619 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.547593    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g2g24"]
Sep 10 20:59:04.548284 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.548264    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v8pqm"]
Sep 10 20:59:04.564224 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.564183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d855d43a-1872-4673-ac57-8bdc54f80907-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hw6z5\" (UID: \"d855d43a-1872-4673-ac57-8bdc54f80907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:04.581924 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.581892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.636743 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.636707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:04.665462 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:04.665418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d855d43a-1872-4673-ac57-8bdc54f80907-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hw6z5\" (UID: \"d855d43a-1872-4673-ac57-8bdc54f80907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:04.665603 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:59:04.665547    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 20:59:04.665657 ip-10-0-135-116 kubenswrapper[2573]: E0910 20:59:04.665619    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d855d43a-1872-4673-ac57-8bdc54f80907-tls-certificates podName:d855d43a-1872-4673-ac57-8bdc54f80907 nodeName:}" failed. No retries permitted until 2026-09-10 20:59:05.165601536 +0000 UTC m=+67.599431478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d855d43a-1872-4673-ac57-8bdc54f80907-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-hw6z5" (UID: "d855d43a-1872-4673-ac57-8bdc54f80907") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 20:59:04.679483 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:04.679446    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd636cf86_f3ef_445e_b2a0_7ed4762a3444.slice/crio-20a3020751342ae7d6fe07955ea0234cbce40e26a4afc29a5a81f1a7146b21a7 WatchSource:0}: Error finding container 20a3020751342ae7d6fe07955ea0234cbce40e26a4afc29a5a81f1a7146b21a7: Status 404 returned error can't find the container with id 20a3020751342ae7d6fe07955ea0234cbce40e26a4afc29a5a81f1a7146b21a7
Sep 10 20:59:04.680416 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:04.680378    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40579060_85b2_4b38_9eb7_2a97dfb3780b.slice/crio-31311ca9b554a11f71e2e41820a75812b544b25241f9aacd43c1b7a41da5f8b6 WatchSource:0}: Error finding container 31311ca9b554a11f71e2e41820a75812b544b25241f9aacd43c1b7a41da5f8b6: Status 404 returned error can't find the container with id 31311ca9b554a11f71e2e41820a75812b544b25241f9aacd43c1b7a41da5f8b6
Sep 10 20:59:04.681235 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:04.681215    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2404ec37_e8a7_4eb2_b841_a20815a2464a.slice/crio-beabff451ea411e5d256272c1a6337bd3046d17dcf36d64467857d32abac6d65 WatchSource:0}: Error finding container beabff451ea411e5d256272c1a6337bd3046d17dcf36d64467857d32abac6d65: Status 404 returned error can't find the container with id beabff451ea411e5d256272c1a6337bd3046d17dcf36d64467857d32abac6d65
Sep 10 20:59:04.681929 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:04.681907    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31902c8e_2222_4b0e_8adf_7796567b1f9e.slice/crio-88717164ba39032370344bc58fae3394a8292a21705c866e4c21e1ce8da89e8f WatchSource:0}: Error finding container 88717164ba39032370344bc58fae3394a8292a21705c866e4c21e1ce8da89e8f: Status 404 returned error can't find the container with id 88717164ba39032370344bc58fae3394a8292a21705c866e4c21e1ce8da89e8f
Sep 10 20:59:05.101248 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.101207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:05.170700 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.170293    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d855d43a-1872-4673-ac57-8bdc54f80907-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hw6z5\" (UID: \"d855d43a-1872-4673-ac57-8bdc54f80907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:05.173572 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.173505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d855d43a-1872-4673-ac57-8bdc54f80907-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-hw6z5\" (UID: \"d855d43a-1872-4673-ac57-8bdc54f80907\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:05.428446 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.428343    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:05.441771 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.441722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p" event={"ID":"a20d09a3-2d63-4816-ba40-53bfe864f1ca","Type":"ContainerStarted","Data":"fb45936409316b3ce8119eb1be69987ab3b1fec10f72fe4ec4fb7bb501ca9b6d"}
Sep 10 20:59:05.444077 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.444044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p4kv6" event={"ID":"31902c8e-2222-4b0e-8adf-7796567b1f9e","Type":"ContainerStarted","Data":"88717164ba39032370344bc58fae3394a8292a21705c866e4c21e1ce8da89e8f"}
Sep 10 20:59:05.445641 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.445610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g2g24" event={"ID":"40579060-85b2-4b38-9eb7-2a97dfb3780b","Type":"ContainerStarted","Data":"31311ca9b554a11f71e2e41820a75812b544b25241f9aacd43c1b7a41da5f8b6"}
Sep 10 20:59:05.447392 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.447364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v8pqm" event={"ID":"2404ec37-e8a7-4eb2-b841-a20815a2464a","Type":"ContainerStarted","Data":"beabff451ea411e5d256272c1a6337bd3046d17dcf36d64467857d32abac6d65"}
Sep 10 20:59:05.450332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.450253    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54wrf" event={"ID":"d636cf86-f3ef-445e-b2a0-7ed4762a3444","Type":"ContainerStarted","Data":"20a3020751342ae7d6fe07955ea0234cbce40e26a4afc29a5a81f1a7146b21a7"}
Sep 10 20:59:05.461007 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.460335    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c967b87d-csv9p" podStartSLOduration=1.546449223 podStartE2EDuration="4.460314344s" totalImagesPullingTime="2.913865121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:05.458532336 +0000 UTC m=+67.892362288" watchObservedRunningTime="2026-09-10 20:59:05.460314344 +0000 UTC m=+67.894144297"
Sep 10 20:59:05.762729 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:05.762046    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"]
Sep 10 20:59:05.988000 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:05.987891    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd855d43a_1872_4673_ac57_8bdc54f80907.slice/crio-77a3d2dda31ce0321dcc2bce77d44ef236c67540239357dc02b4970311ceb46f WatchSource:0}: Error finding container 77a3d2dda31ce0321dcc2bce77d44ef236c67540239357dc02b4970311ceb46f: Status 404 returned error can't find the container with id 77a3d2dda31ce0321dcc2bce77d44ef236c67540239357dc02b4970311ceb46f
Sep 10 20:59:06.458180 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:06.458146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5" event={"ID":"d855d43a-1872-4673-ac57-8bdc54f80907","Type":"ContainerStarted","Data":"77a3d2dda31ce0321dcc2bce77d44ef236c67540239357dc02b4970311ceb46f"}
Sep 10 20:59:07.465129 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.465092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v8pqm" event={"ID":"2404ec37-e8a7-4eb2-b841-a20815a2464a","Type":"ContainerStarted","Data":"c0d9bf743ac4ee6a4b14f26b4a363ededd9411e2e741f549463dde795ae1f2b1"}
Sep 10 20:59:07.465612 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.465164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v8pqm" event={"ID":"2404ec37-e8a7-4eb2-b841-a20815a2464a","Type":"ContainerStarted","Data":"90ea0ac85a70819219d749b1186c80ed1d3fb6a90614ce5112ffba1d21ba68dd"}
Sep 10 20:59:07.467507 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.467435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p4kv6" event={"ID":"31902c8e-2222-4b0e-8adf-7796567b1f9e","Type":"ContainerStarted","Data":"e6afd4c9b5621f704d309947c6db60790a3ce9f1f43038f700bcddf193a268aa"}
Sep 10 20:59:07.467507 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.467488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p4kv6" event={"ID":"31902c8e-2222-4b0e-8adf-7796567b1f9e","Type":"ContainerStarted","Data":"9845de33e2c36231f16db66013690b40cec86f714493d30b447ec1b96c867642"}
Sep 10 20:59:07.467713 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.467610    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:59:07.481774 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.481723    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v8pqm" podStartSLOduration=67.375112694 podStartE2EDuration="1m9.481702947s" totalImagesPullingTime="2.106590253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:07.480243155 +0000 UTC m=+69.914073112" watchObservedRunningTime="2026-09-10 20:59:07.481702947 +0000 UTC m=+69.915532897"
Sep 10 20:59:07.497896 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.497848    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p4kv6" podStartSLOduration=34.363585428 podStartE2EDuration="36.497833486s" totalImagesPullingTime="2.134248058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:07.497091102 +0000 UTC m=+69.930921051" watchObservedRunningTime="2026-09-10 20:59:07.497833486 +0000 UTC m=+69.931663434"
Sep 10 20:59:07.562282 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.562240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.659181 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.659144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:07.715269 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:07.715183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:10.479550 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.479507    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5" event={"ID":"d855d43a-1872-4673-ac57-8bdc54f80907","Type":"ContainerStarted","Data":"08bb0241e7564c2c94c7d0b915e7ccb380b58998a8271ee6dda31851134ceb1f"}
Sep 10 20:59:10.480007 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.479576    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:10.481137 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.481110    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g2g24" event={"ID":"40579060-85b2-4b38-9eb7-2a97dfb3780b","Type":"ContainerStarted","Data":"87a8347b2b8b6c9a6ff373ffadbe51418e206e2f6283fa0bb20e10e7e21c67f3"}
Sep 10 20:59:10.482693 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.482664    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-54wrf" event={"ID":"d636cf86-f3ef-445e-b2a0-7ed4762a3444","Type":"ContainerStarted","Data":"c33aed92bcd11fdb338fa958d3393871003bf10a20c96fb300dbb108c967dc1b"}
Sep 10 20:59:10.482804 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.482792    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:59:10.485040 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.485020    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5"
Sep 10 20:59:10.495468 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.495345    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-hw6z5" podStartSLOduration=2.653271128 podStartE2EDuration="6.495329159s" totalImagesPullingTime="3.842058031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:10.495117157 +0000 UTC m=+72.928947106" watchObservedRunningTime="2026-09-10 20:59:10.495329159 +0000 UTC m=+72.929159107"
Sep 10 20:59:10.525497 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.525438    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g2g24" podStartSLOduration=67.382042642 podStartE2EDuration="1m12.525416876s" totalImagesPullingTime="5.143374234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:10.508430685 +0000 UTC m=+72.942260631" watchObservedRunningTime="2026-09-10 20:59:10.525416876 +0000 UTC m=+72.959246818"
Sep 10 20:59:10.526338 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:10.526308    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-54wrf" podStartSLOduration=67.396882633 podStartE2EDuration="1m12.526298846s" totalImagesPullingTime="5.129416213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:10.525357777 +0000 UTC m=+72.959187727" watchObservedRunningTime="2026-09-10 20:59:10.526298846 +0000 UTC m=+72.960128805"
Sep 10 20:59:11.530285 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.530252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:11.556355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.556324    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"]
Sep 10 20:59:11.558146 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.558131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.561819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.561771    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 20:59:11.561819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.561793    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 20:59:11.561819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.561776    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 20:59:11.562046 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.561857    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-znpkl\""
Sep 10 20:59:11.562046 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.561887    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 20:59:11.562046 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.561892    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 20:59:11.567368 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.567347    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"]
Sep 10 20:59:11.593360 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.593331    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:11.621500 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.621474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c624d33-94ee-4c06-97d8-84836ab17b75-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.621631 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.621610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c624d33-94ee-4c06-97d8-84836ab17b75-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.621719 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.621648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c624d33-94ee-4c06-97d8-84836ab17b75-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.621719 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.621673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6s7k\" (UniqueName: \"kubernetes.io/projected/4c624d33-94ee-4c06-97d8-84836ab17b75-kube-api-access-l6s7k\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.673735 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.673702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:11.723003 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.722971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c624d33-94ee-4c06-97d8-84836ab17b75-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.723128 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.723006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c624d33-94ee-4c06-97d8-84836ab17b75-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.723128 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.723027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6s7k\" (UniqueName: \"kubernetes.io/projected/4c624d33-94ee-4c06-97d8-84836ab17b75-kube-api-access-l6s7k\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.723128 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.723085    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c624d33-94ee-4c06-97d8-84836ab17b75-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.723863 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.723831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c624d33-94ee-4c06-97d8-84836ab17b75-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.725542 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.725525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c624d33-94ee-4c06-97d8-84836ab17b75-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.725628 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.725612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c624d33-94ee-4c06-97d8-84836ab17b75-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.730667 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.730646    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6s7k\" (UniqueName: \"kubernetes.io/projected/4c624d33-94ee-4c06-97d8-84836ab17b75-kube-api-access-l6s7k\") pod \"prometheus-operator-68bcd7f987-4l7w9\" (UID: \"4c624d33-94ee-4c06-97d8-84836ab17b75\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.867485 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.867446    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"
Sep 10 20:59:11.913332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.913259    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-9ct2d"]
Sep 10 20:59:11.916909 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.916390    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:11.919514 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.919099    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 20:59:11.919514 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.919113    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lcf9z\""
Sep 10 20:59:11.919514 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.919102    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 20:59:11.936082 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.936048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:11.937215 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:11.937195    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-9ct2d"]
Sep 10 20:59:12.025580 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.025544    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxjhs\" (UniqueName: \"kubernetes.io/projected/c2e6714f-e65f-4c23-91a9-8f3b15d0843d-kube-api-access-rxjhs\") pod \"downloads-76f99584f4-9ct2d\" (UID: \"c2e6714f-e65f-4c23-91a9-8f3b15d0843d\") " pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:12.036648 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.036617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.126705 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.126627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjhs\" (UniqueName: \"kubernetes.io/projected/c2e6714f-e65f-4c23-91a9-8f3b15d0843d-kube-api-access-rxjhs\") pod \"downloads-76f99584f4-9ct2d\" (UID: \"c2e6714f-e65f-4c23-91a9-8f3b15d0843d\") " pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:12.135392 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.135371    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9"]
Sep 10 20:59:12.137732 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.137696    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxjhs\" (UniqueName: \"kubernetes.io/projected/c2e6714f-e65f-4c23-91a9-8f3b15d0843d-kube-api-access-rxjhs\") pod \"downloads-76f99584f4-9ct2d\" (UID: \"c2e6714f-e65f-4c23-91a9-8f3b15d0843d\") " pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:12.137855 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.137702    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.138330 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:12.138309    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c624d33_94ee_4c06_97d8_84836ab17b75.slice/crio-4a7fc371c869c65c6d47582ef49f2b5312d4a8d0a672a0078447c669b8196f3d WatchSource:0}: Error finding container 4a7fc371c869c65c6d47582ef49f2b5312d4a8d0a672a0078447c669b8196f3d: Status 404 returned error can't find the container with id 4a7fc371c869c65c6d47582ef49f2b5312d4a8d0a672a0078447c669b8196f3d
Sep 10 20:59:12.227346 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.227289    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:12.236922 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.236898    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.294560 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.294528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.407484 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.407387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.493361 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.493321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-9ct2d"]
Sep 10 20:59:12.494632 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.494607    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9" event={"ID":"4c624d33-94ee-4c06-97d8-84836ab17b75","Type":"ContainerStarted","Data":"4a7fc371c869c65c6d47582ef49f2b5312d4a8d0a672a0078447c669b8196f3d"}
Sep 10 20:59:12.496096 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:12.496062    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e6714f_e65f_4c23_91a9_8f3b15d0843d.slice/crio-896af621154a43ecdb9d0a77390d12276687962e3640d96f4ae286a8e5912bda WatchSource:0}: Error finding container 896af621154a43ecdb9d0a77390d12276687962e3640d96f4ae286a8e5912bda: Status 404 returned error can't find the container with id 896af621154a43ecdb9d0a77390d12276687962e3640d96f4ae286a8e5912bda
Sep 10 20:59:12.498647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.498628    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.605946 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.605909    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.801864 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.801783    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:12.902872 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:12.902844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:13.507949 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.507904    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9" event={"ID":"4c624d33-94ee-4c06-97d8-84836ab17b75","Type":"ContainerStarted","Data":"8a87f193a2bdbc974cfb48db90e1393c74b46db07ad04ceded21e6d0d2b432d2"}
Sep 10 20:59:13.508119 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.507972    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9" event={"ID":"4c624d33-94ee-4c06-97d8-84836ab17b75","Type":"ContainerStarted","Data":"c0ed3ba194cdf097ff91842e0908ad0155d3a6df3da22022c8c4767b5b4184ec"}
Sep 10 20:59:13.510068 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.510039    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-9ct2d" event={"ID":"c2e6714f-e65f-4c23-91a9-8f3b15d0843d","Type":"ContainerStarted","Data":"896af621154a43ecdb9d0a77390d12276687962e3640d96f4ae286a8e5912bda"}
Sep 10 20:59:13.524257 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.524005    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-4l7w9" podStartSLOduration=1.355486283 podStartE2EDuration="2.523986083s" totalImagesPullingTime="1.1684998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:13.522744805 +0000 UTC m=+75.956574756" watchObservedRunningTime="2026-09-10 20:59:13.523986083 +0000 UTC m=+75.957816033"
Sep 10 20:59:13.550579 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.550546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:13.811895 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.811866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:13.912358 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:13.912330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:14.013157 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:14.013121    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:14.631171 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:14.631131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:14.683752 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:14.683706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.665452 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.665395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.920018 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.919929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:15.943647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.943615    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zvpl8"]
Sep 10 20:59:15.945968 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.945947    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:15.948671 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.948646    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 20:59:15.948671 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.948667    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 20:59:15.948851 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.948723    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-46kj6\""
Sep 10 20:59:15.948943 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.948905    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 20:59:15.956051 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.956028    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"]
Sep 10 20:59:15.958549 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.958528    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:15.961105 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.961076    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 20:59:15.961267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.961227    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 20:59:15.961267 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.961264    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 20:59:15.961393 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.961316    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mwlr4\""
Sep 10 20:59:15.976094 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:15.976063    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"]
Sep 10 20:59:16.016215 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.016171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.056872 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.056832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpw9r\" (UniqueName: \"kubernetes.io/projected/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-api-access-kpw9r\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.057068 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.056879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-wtmp\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057068 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.056980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-tls\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057068 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.057206 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.057206 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.057206 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ad4b19-a57a-4e29-bc62-8faab79874aa-metrics-client-ca\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.057355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-textfile\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-root\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057571 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057571 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmkn\" (UniqueName: \"kubernetes.io/projected/31ad4b19-a57a-4e29-bc62-8faab79874aa-kube-api-access-xbmkn\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.057571 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.057571 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.057509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-sys\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.116685 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.116648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.158956 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.158917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.158956 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.158960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159207 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.158978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ad4b19-a57a-4e29-bc62-8faab79874aa-metrics-client-ca\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159207 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159207 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-textfile\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159207 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-root\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159207 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159202    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmkn\" (UniqueName: \"kubernetes.io/projected/31ad4b19-a57a-4e29-bc62-8faab79874aa-kube-api-access-xbmkn\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-sys\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw9r\" (UniqueName: \"kubernetes.io/projected/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-api-access-kpw9r\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-wtmp\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159439    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-tls\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159476 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159720 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159720 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159678    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31ad4b19-a57a-4e29-bc62-8faab79874aa-metrics-client-ca\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159787 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-textfile\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159830 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159883 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159853    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.159936 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-sys\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.159936 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.159920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-root\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.160051 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.160018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-wtmp\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.160320 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.160297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.162436 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.162386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.162575 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.162491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31ad4b19-a57a-4e29-bc62-8faab79874aa-node-exporter-tls\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.162718 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.162695    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.162880 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.162734    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.168576 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.168387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpw9r\" (UniqueName: \"kubernetes.io/projected/3b07e001-c07b-47cb-9f71-1a5f315c8d3c-kube-api-access-kpw9r\") pod \"kube-state-metrics-59fbdd77d-wmgw4\" (UID: \"3b07e001-c07b-47cb-9f71-1a5f315c8d3c\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.168576 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.168531    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmkn\" (UniqueName: \"kubernetes.io/projected/31ad4b19-a57a-4e29-bc62-8faab79874aa-kube-api-access-xbmkn\") pod \"node-exporter-zvpl8\" (UID: \"31ad4b19-a57a-4e29-bc62-8faab79874aa\") " pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.219412 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.219303    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.256778 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.256746    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zvpl8"
Sep 10 20:59:16.268708 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.268674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"
Sep 10 20:59:16.268952 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:16.268927    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ad4b19_a57a_4e29_bc62_8faab79874aa.slice/crio-5537d2492c7ab76f0cef780f6b0cec6660793bdfae5929a7ca7242ecdf33040d WatchSource:0}: Error finding container 5537d2492c7ab76f0cef780f6b0cec6660793bdfae5929a7ca7242ecdf33040d: Status 404 returned error can't find the container with id 5537d2492c7ab76f0cef780f6b0cec6660793bdfae5929a7ca7242ecdf33040d
Sep 10 20:59:16.321005 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.320948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.415840 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.415807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.514312 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.514235    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.523101 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.523069    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvpl8" event={"ID":"31ad4b19-a57a-4e29-bc62-8faab79874aa","Type":"ContainerStarted","Data":"5537d2492c7ab76f0cef780f6b0cec6660793bdfae5929a7ca7242ecdf33040d"}
Sep 10 20:59:16.547103 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.547030    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4"]
Sep 10 20:59:16.549074 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:16.549047    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b07e001_c07b_47cb_9f71_1a5f315c8d3c.slice/crio-41fe854c1baca0db992af4f787610c97678d59a034f78962786686cd009bae28 WatchSource:0}: Error finding container 41fe854c1baca0db992af4f787610c97678d59a034f78962786686cd009bae28: Status 404 returned error can't find the container with id 41fe854c1baca0db992af4f787610c97678d59a034f78962786686cd009bae28
Sep 10 20:59:16.885323 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.885287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:16.984723 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:16.984671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:17.098076 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:17.098037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:17.473168 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:17.473023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p4kv6"
Sep 10 20:59:17.536733 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:17.536107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvpl8" event={"ID":"31ad4b19-a57a-4e29-bc62-8faab79874aa","Type":"ContainerStarted","Data":"65a49d753a79d6b805f7de8cd83e81286cd510f508fc29173020f4583c341d41"}
Sep 10 20:59:17.538018 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:17.537976    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4" event={"ID":"3b07e001-c07b-47cb-9f71-1a5f315c8d3c","Type":"ContainerStarted","Data":"41fe854c1baca0db992af4f787610c97678d59a034f78962786686cd009bae28"}
Sep 10 20:59:18.479470 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.479433    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:18.537130 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.537094    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:18.544246 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.544203    2573 generic.go:356] "Generic (PLEG): container finished" podID="31ad4b19-a57a-4e29-bc62-8faab79874aa" containerID="65a49d753a79d6b805f7de8cd83e81286cd510f508fc29173020f4583c341d41" exitCode=0
Sep 10 20:59:18.544453 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.544271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvpl8" event={"ID":"31ad4b19-a57a-4e29-bc62-8faab79874aa","Type":"ContainerDied","Data":"65a49d753a79d6b805f7de8cd83e81286cd510f508fc29173020f4583c341d41"}
Sep 10 20:59:18.547508 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.547478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4" event={"ID":"3b07e001-c07b-47cb-9f71-1a5f315c8d3c","Type":"ContainerStarted","Data":"a3bd8eaed230e5dc252c931af8cc7b4a09bc46a6b0d2136d77d241359f277727"}
Sep 10 20:59:18.547622 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.547539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4" event={"ID":"3b07e001-c07b-47cb-9f71-1a5f315c8d3c","Type":"ContainerStarted","Data":"c68640396f32ec3b531962871685e61aa7c65a5e1842eebf59c027b5527fd74d"}
Sep 10 20:59:18.547622 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.547567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4" event={"ID":"3b07e001-c07b-47cb-9f71-1a5f315c8d3c","Type":"ContainerStarted","Data":"32fcad775cc4bc491422cc929fb9240bf3336d7427cbf4205305de47b4c73216"}
Sep 10 20:59:18.580917 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.580674    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wmgw4" podStartSLOduration=2.290973598 podStartE2EDuration="3.580654396s" totalImagesPullingTime="1.289680798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:18.580126409 +0000 UTC m=+81.013956366" watchObservedRunningTime="2026-09-10 20:59:18.580654396 +0000 UTC m=+81.014484347"
Sep 10 20:59:18.830561 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.830515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:18.909119 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:18.909084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:19.250111 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:19.250024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:19.558319 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:19.558224    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvpl8" event={"ID":"31ad4b19-a57a-4e29-bc62-8faab79874aa","Type":"ContainerStarted","Data":"2bc68ebc9c4441fe34a1bd3687bd2d0220b6ec37b7deb52c0d403967bdc927bb"}
Sep 10 20:59:19.558775 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:19.558318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvpl8" event={"ID":"31ad4b19-a57a-4e29-bc62-8faab79874aa","Type":"ContainerStarted","Data":"5577fa5976e098878e8c010272f4a9ce20b691aa28cc15a30a773b9677705707"}
Sep 10 20:59:19.578135 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:19.578076    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zvpl8" podStartSLOduration=3.522643703 podStartE2EDuration="4.57805766s" totalImagesPullingTime="975.218322ms" totalInitContainerRuntime="80.195635ms" isStatefulPod=true podCreationTimestamp="2026-09-10 20:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:19.577040226 +0000 UTC m=+82.010870174" watchObservedRunningTime="2026-09-10 20:59:19.57805766 +0000 UTC m=+82.011887652"
Sep 10 20:59:20.315112 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.314979    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b77cd6694-sc74x"]
Sep 10 20:59:20.319531 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.319500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.323125 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.323092    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 20:59:20.323291 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.323099    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 20:59:20.323291 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.323147    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bqhqskfj7f6db\""
Sep 10 20:59:20.323291 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.323104    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 20:59:20.323291 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.323103    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 20:59:20.323291 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.323146    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t45cw\""
Sep 10 20:59:20.328851 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.328778    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b77cd6694-sc74x"]
Sep 10 20:59:20.399930 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.399892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-secret-metrics-server-tls\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.400110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.399946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd3d372f-f376-4778-8f16-00b1a4e7a88d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.400110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.399979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bd3d372f-f376-4778-8f16-00b1a4e7a88d-metrics-server-audit-profiles\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.400110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.400010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bd3d372f-f376-4778-8f16-00b1a4e7a88d-audit-log\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.400110 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.400038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-client-ca-bundle\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.400265 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.400163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-secret-metrics-server-client-certs\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.400265 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.400229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66lxr\" (UniqueName: \"kubernetes.io/projected/bd3d372f-f376-4778-8f16-00b1a4e7a88d-kube-api-access-66lxr\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501596 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-secret-metrics-server-client-certs\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66lxr\" (UniqueName: \"kubernetes.io/projected/bd3d372f-f376-4778-8f16-00b1a4e7a88d-kube-api-access-66lxr\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-secret-metrics-server-tls\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd3d372f-f376-4778-8f16-00b1a4e7a88d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bd3d372f-f376-4778-8f16-00b1a4e7a88d-metrics-server-audit-profiles\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bd3d372f-f376-4778-8f16-00b1a4e7a88d-audit-log\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.501797 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.501762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-client-ca-bundle\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.502268 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.502238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bd3d372f-f376-4778-8f16-00b1a4e7a88d-audit-log\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.502572 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.502526    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd3d372f-f376-4778-8f16-00b1a4e7a88d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.502941 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.502918    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bd3d372f-f376-4778-8f16-00b1a4e7a88d-metrics-server-audit-profiles\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.504594 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.504568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-secret-metrics-server-tls\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.504689 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.504668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-client-ca-bundle\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.504879 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.504862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bd3d372f-f376-4778-8f16-00b1a4e7a88d-secret-metrics-server-client-certs\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.510501 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.510475    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66lxr\" (UniqueName: \"kubernetes.io/projected/bd3d372f-f376-4778-8f16-00b1a4e7a88d-kube-api-access-66lxr\") pod \"metrics-server-5b77cd6694-sc74x\" (UID: \"bd3d372f-f376-4778-8f16-00b1a4e7a88d\") " pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.589334 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.589295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:20.632220 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.632185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:20.689421 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.689367    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:20.689858 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.689831    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"]
Sep 10 20:59:20.693912 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.693881    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.698204 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.696233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 10 20:59:20.698204 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.696303    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2fm87\""
Sep 10 20:59:20.706769 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.706637    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"]
Sep 10 20:59:20.745972 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.745939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:20.805307 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.805263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f675b250-f978-4494-9219-c3ecb6ad1851-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zrf4v\" (UID: \"f675b250-f978-4494-9219-c3ecb6ad1851\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.805482 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.805332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqj9\" (UniqueName: \"kubernetes.io/projected/f675b250-f978-4494-9219-c3ecb6ad1851-kube-api-access-dqqj9\") pod \"monitoring-plugin-5d85778b9d-zrf4v\" (UID: \"f675b250-f978-4494-9219-c3ecb6ad1851\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.830847 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.830801    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:20.906342 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.906256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f675b250-f978-4494-9219-c3ecb6ad1851-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zrf4v\" (UID: \"f675b250-f978-4494-9219-c3ecb6ad1851\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.906342 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.906314    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqj9\" (UniqueName: \"kubernetes.io/projected/f675b250-f978-4494-9219-c3ecb6ad1851-kube-api-access-dqqj9\") pod \"monitoring-plugin-5d85778b9d-zrf4v\" (UID: \"f675b250-f978-4494-9219-c3ecb6ad1851\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.909208 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.909132    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f675b250-f978-4494-9219-c3ecb6ad1851-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-zrf4v\" (UID: \"f675b250-f978-4494-9219-c3ecb6ad1851\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.915614 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.915579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqj9\" (UniqueName: \"kubernetes.io/projected/f675b250-f978-4494-9219-c3ecb6ad1851-kube-api-access-dqqj9\") pod \"monitoring-plugin-5d85778b9d-zrf4v\" (UID: \"f675b250-f978-4494-9219-c3ecb6ad1851\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:20.926637 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:20.926604    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b77cd6694-sc74x"]
Sep 10 20:59:20.930628 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:20.930590    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3d372f_f376_4778_8f16_00b1a4e7a88d.slice/crio-e865d221bd72c3a8743a7a41e74af63e221383baa545f61539a4579fc9dae9b3 WatchSource:0}: Error finding container e865d221bd72c3a8743a7a41e74af63e221383baa545f61539a4579fc9dae9b3: Status 404 returned error can't find the container with id e865d221bd72c3a8743a7a41e74af63e221383baa545f61539a4579fc9dae9b3
Sep 10 20:59:21.012260 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.012218    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:21.135322 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.135286    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d779bd744-ckpbt"]
Sep 10 20:59:21.138951 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.138924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.141715 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.141686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 20:59:21.141861 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.141767    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 20:59:21.141861 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.141813    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 20:59:21.141968 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.141870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 20:59:21.141968 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.141906    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wbqc5\""
Sep 10 20:59:21.142068 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.141976    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 20:59:21.147705 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.147679    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 20:59:21.152995 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.152914    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d779bd744-ckpbt"]
Sep 10 20:59:21.186226 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.186071    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:21.210090 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-secret-telemeter-client\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210090 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-telemeter-client-tls\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210340 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210112    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210340 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-metrics-client-ca\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210340 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-federate-client-tls\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210340 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk724\" (UniqueName: \"kubernetes.io/projected/898778d1-c747-442b-a1cd-3ddf930ebfea-kube-api-access-pk724\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210557 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-serving-certs-ca-bundle\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.210557 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.210380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.300078 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.300040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"]
Sep 10 20:59:21.303612 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:21.303575    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf675b250_f978_4494_9219_c3ecb6ad1851.slice/crio-d7e6bb9e822cdb6b88a1f4d98390d61d8d20c66a07afd4ed6765978049fbb417 WatchSource:0}: Error finding container d7e6bb9e822cdb6b88a1f4d98390d61d8d20c66a07afd4ed6765978049fbb417: Status 404 returned error can't find the container with id d7e6bb9e822cdb6b88a1f4d98390d61d8d20c66a07afd4ed6765978049fbb417
Sep 10 20:59:21.311470 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311445    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-secret-telemeter-client\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311592 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-telemeter-client-tls\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311592 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311592 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-metrics-client-ca\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311842 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-federate-client-tls\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311975 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk724\" (UniqueName: \"kubernetes.io/projected/898778d1-c747-442b-a1cd-3ddf930ebfea-kube-api-access-pk724\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311975 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-serving-certs-ca-bundle\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.311975 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.311930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.312550 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.312503    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-metrics-client-ca\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.312719 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.312693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-serving-certs-ca-bundle\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.312903 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.312882    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/898778d1-c747-442b-a1cd-3ddf930ebfea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.314754 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.314722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-telemeter-client-tls\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.314876 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.314805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.314937 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.314906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-secret-telemeter-client\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.315649 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.315597    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/898778d1-c747-442b-a1cd-3ddf930ebfea-federate-client-tls\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.320135 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.320115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk724\" (UniqueName: \"kubernetes.io/projected/898778d1-c747-442b-a1cd-3ddf930ebfea-kube-api-access-pk724\") pod \"telemeter-client-7d779bd744-ckpbt\" (UID: \"898778d1-c747-442b-a1cd-3ddf930ebfea\") " pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.451163 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.451071    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt"
Sep 10 20:59:21.569528 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.569473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v" event={"ID":"f675b250-f978-4494-9219-c3ecb6ad1851","Type":"ContainerStarted","Data":"d7e6bb9e822cdb6b88a1f4d98390d61d8d20c66a07afd4ed6765978049fbb417"}
Sep 10 20:59:21.571083 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.571049    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x" event={"ID":"bd3d372f-f376-4778-8f16-00b1a4e7a88d","Type":"ContainerStarted","Data":"e865d221bd72c3a8743a7a41e74af63e221383baa545f61539a4579fc9dae9b3"}
Sep 10 20:59:21.757137 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:21.757014    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d779bd744-ckpbt"]
Sep 10 20:59:21.763113 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:21.763073    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898778d1_c747_442b_a1cd_3ddf930ebfea.slice/crio-54bfce59af38a35248be8e659b81fcaefc0c1bb9a20a41ae4064a29599d6efd2 WatchSource:0}: Error finding container 54bfce59af38a35248be8e659b81fcaefc0c1bb9a20a41ae4064a29599d6efd2: Status 404 returned error can't find the container with id 54bfce59af38a35248be8e659b81fcaefc0c1bb9a20a41ae4064a29599d6efd2
Sep 10 20:59:22.161156 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.158874    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:59:22.164993 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.163617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.171439 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171155    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 20:59:22.171439 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171225    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 20:59:22.171439 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171267    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 20:59:22.171439 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171155    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 20:59:22.171725 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171509    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4vvinnrp4q76b\""
Sep 10 20:59:22.171725 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171156    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 20:59:22.171819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.171725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 20:59:22.177819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.174390    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 20:59:22.177819 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.177671    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 20:59:22.178224 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.178034    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 20:59:22.178224 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.178120    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 20:59:22.178394 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.178233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kcff9\""
Sep 10 20:59:22.178394 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.178316    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 20:59:22.178531 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.178477    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 20:59:22.178894 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.178626    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 20:59:22.179294 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.179200    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:59:22.179637 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.179561    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:22.180247 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.180063    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 20:59:22.227984 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.227945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.227984 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.227986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228035    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228139    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228312    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228352    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9gf\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-kube-api-access-4f9gf\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228522    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.228573 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.229040 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.229040 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.229040 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.228692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.329978 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.329939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.329995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330197    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330309    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.330647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.331332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330694    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.331332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330742    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9gf\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-kube-api-access-4f9gf\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.331332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.331332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.331332 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.330900    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.331701 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.331604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.332648 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.331943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.332648 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.331977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.332648 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.332011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.332648 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.332236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.333216 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.333185    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.334037 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.334011    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.334120 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.334023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.336029 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.336006    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.339486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.338924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config-out\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.339486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.339228    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.339486 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.339423    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.339930 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.339774    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.340247 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.340166    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-web-config\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.340647 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.340626    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.342211 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.342168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.343248 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.342961    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.343861 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.343562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.343861 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.343795    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.344001 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.343935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.345355 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.345303    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9gf\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-kube-api-access-4f9gf\") pod \"prometheus-k8s-0\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.487871 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.487786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:22.581222 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:22.581186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt" event={"ID":"898778d1-c747-442b-a1cd-3ddf930ebfea","Type":"ContainerStarted","Data":"54bfce59af38a35248be8e659b81fcaefc0c1bb9a20a41ae4064a29599d6efd2"}
Sep 10 20:59:23.437158 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:23.437127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-698ffb8ff8-qpbb7"
Sep 10 20:59:23.606901 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:23.606855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:23.706857 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:23.706760    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.028193 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:27.028146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.127703 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:27.127663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.390978 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:27.390941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:27.490695 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:27.490662    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.192937 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:30.192836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.292275 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:30.292237    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:30.839380 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:30.839357    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 20:59:31.053994 ip-10-0-135-116 kubenswrapper[2573]: W0910 20:59:31.053943    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc0b190_9ce1_4f5b_9bd3_ac969db768c1.slice/crio-642e4de9cacf9fe83692169c55a0d1fc2a8e47dcf992013ed0c6d612caa678e8 WatchSource:0}: Error finding container 642e4de9cacf9fe83692169c55a0d1fc2a8e47dcf992013ed0c6d612caa678e8: Status 404 returned error can't find the container with id 642e4de9cacf9fe83692169c55a0d1fc2a8e47dcf992013ed0c6d612caa678e8
Sep 10 20:59:31.244179 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.244130    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:31.345327 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.345244    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:31.623240 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.623148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt" event={"ID":"898778d1-c747-442b-a1cd-3ddf930ebfea","Type":"ContainerStarted","Data":"db7b16ee3488c320dd5394198c8545c33e83c49dcf98e39b72803f2eee5d791d"}
Sep 10 20:59:31.625024 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.624988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-9ct2d" event={"ID":"c2e6714f-e65f-4c23-91a9-8f3b15d0843d","Type":"ContainerStarted","Data":"ee349175df59014e3e7ac0d488fa675d6f86e85fca7bc711d9c3bcc60894e33a"}
Sep 10 20:59:31.625374 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.625341    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:31.627055 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.626953    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v" event={"ID":"f675b250-f978-4494-9219-c3ecb6ad1851","Type":"ContainerStarted","Data":"4a9846ad8d7bd8786f372d49d2e6234bd925fba7b96d6b2985818d1514a22d2c"}
Sep 10 20:59:31.628069 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.628051    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:31.629187 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.629153    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"642e4de9cacf9fe83692169c55a0d1fc2a8e47dcf992013ed0c6d612caa678e8"}
Sep 10 20:59:31.631177 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.631155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x" event={"ID":"bd3d372f-f376-4778-8f16-00b1a4e7a88d","Type":"ContainerStarted","Data":"bb2b4e1dc755d1b44800c21480ee6c5c00603407391a844693387571f9a4cafe"}
Sep 10 20:59:31.633092 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.633071    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v"
Sep 10 20:59:31.639530 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.639508    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-9ct2d"
Sep 10 20:59:31.660746 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.660686    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-9ct2d" podStartSLOduration=2.101175012 podStartE2EDuration="20.660661037s" totalImagesPullingTime="18.559486025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:31.658534352 +0000 UTC m=+94.092364315" watchObservedRunningTime="2026-09-10 20:59:31.660661037 +0000 UTC m=+94.094490988"
Sep 10 20:59:31.714697 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.712050    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-zrf4v" podStartSLOduration=2.457551975 podStartE2EDuration="11.712025475s" totalImagesPullingTime="9.2544735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:31.711866958 +0000 UTC m=+94.145696907" watchObservedRunningTime="2026-09-10 20:59:31.712025475 +0000 UTC m=+94.145855425"
Sep 10 20:59:31.732784 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:31.732729    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x" podStartSLOduration=2.1072563 podStartE2EDuration="11.732710836s" totalImagesPullingTime="9.625454536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:31.730732493 +0000 UTC m=+94.164562439" watchObservedRunningTime="2026-09-10 20:59:31.732710836 +0000 UTC m=+94.166540786"
Sep 10 20:59:33.479424 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.479369    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:33.580390 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.580359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:33.642296 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.642257    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76" exitCode=0
Sep 10 20:59:33.642488 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.642346    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"}
Sep 10 20:59:33.645313 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.645283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt" event={"ID":"898778d1-c747-442b-a1cd-3ddf930ebfea","Type":"ContainerStarted","Data":"80013cee43b618e78f1f3c814af02442b99f02886369d1527cacb3ccfbef94ef"}
Sep 10 20:59:33.645452 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.645360    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt" event={"ID":"898778d1-c747-442b-a1cd-3ddf930ebfea","Type":"ContainerStarted","Data":"b25d3323d304dc8908991d6cbbe1fe624b3e9a69c51baf7ce2ca6f76d08bdd1a"}
Sep 10 20:59:33.691246 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:33.691183    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d779bd744-ckpbt" podStartSLOduration=1.363376615 podStartE2EDuration="12.69116184s" totalImagesPullingTime="11.327785225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:33.690868609 +0000 UTC m=+96.124698559" watchObservedRunningTime="2026-09-10 20:59:33.69116184 +0000 UTC m=+96.124991790"
Sep 10 20:59:35.037070 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:35.037034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:36.439227 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:36.439163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:36.496953 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:36.496912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:36.661250 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:36.661101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:36.721156 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:36.721049    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:38.676999 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:38.676960    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"}
Sep 10 20:59:38.677451 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:38.677044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"}
Sep 10 20:59:40.632719 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:40.632678    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:40.633191 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:40.632748    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 20:59:40.688992 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:40.688893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"}
Sep 10 20:59:41.492660 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:41.492630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-54wrf"
Sep 10 20:59:41.697295 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:41.697260    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"}
Sep 10 20:59:41.697698 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:41.697329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"}
Sep 10 20:59:41.697698 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:41.697371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerStarted","Data":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"}
Sep 10 20:59:41.723693 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:41.723636    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=11.025693724 podStartE2EDuration="19.723615767s" totalImagesPullingTime="8.675397819s" totalInitContainerRuntime="22.524224ms" isStatefulPod=false podCreationTimestamp="2026-09-10 20:59:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:59:41.721455645 +0000 UTC m=+104.155285595" watchObservedRunningTime="2026-09-10 20:59:41.723615767 +0000 UTC m=+104.157445715"
Sep 10 20:59:42.488442 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:42.488377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 20:59:46.340907 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:46.340855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:46.550685 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:46.550648    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:46.642807 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:46.642721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:48.470761 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:48.470724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 20:59:48.522118 ip-10-0-135-116 kubenswrapper[2573]: I0910 20:59:48.522081    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:00.637782 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:00.637748    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 21:00:00.641650 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:00.641603    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b77cd6694-sc74x"
Sep 10 21:00:21.828211 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:21.828165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:22.488493 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:22.488450    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:22.554211 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:22.554183    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:22.873884 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:22.873854    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:31.991971 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:31.991936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:32.093131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:32.093089    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:40.510902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.510862    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 21:00:40.511526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.511279    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy" containerID="cri-o://af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b" gracePeriod=600
Sep 10 21:00:40.511526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.511313    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="thanos-sidecar" containerID="cri-o://b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea" gracePeriod=600
Sep 10 21:00:40.511526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.511332    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd" gracePeriod=600
Sep 10 21:00:40.511526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.511293    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="prometheus" containerID="cri-o://75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564" gracePeriod=600
Sep 10 21:00:40.511526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.511323    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="config-reloader" containerID="cri-o://e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462" gracePeriod=600
Sep 10 21:00:40.511526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.511333    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-web" containerID="cri-o://050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4" gracePeriod=600
Sep 10 21:00:40.770056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.769986    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:40.834840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.834805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-thanos-prometheus-http-client-file\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.834853    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.834894    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-kubelet-serving-ca-bundle\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.834923    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-2\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.834953    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-tls-assets\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835296 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835251    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.835296 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835285    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-metrics-client-ca\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835459 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835335    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835459 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835374    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-0\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835459 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835430    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-kube-rbac-proxy\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835488    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f9gf\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-kube-api-access-4f9gf\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835525    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-web-config\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835559    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config-out\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-serving-certs-ca-bundle\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-metrics-client-certs\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835650    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-tls\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835677    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-grpc-tls\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835705    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835731    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-1\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835768    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-db\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835792    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.835824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.835805    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-trusted-ca-bundle\") pod \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\" (UID: \"adc0b190-9ce1-4f5b-9bd3-ac969db768c1\") "
Sep 10 21:00:40.836180 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.836074    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.836180 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.836092    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-metrics-client-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.836180 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.836106    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.836516 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.836493    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.837167 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.837139    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.838088 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.838055    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.838274 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.838243    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:40.841792 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.841761    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.842391 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.842350    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.843541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.843282    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:00:40.844006 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.843976    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:40.844125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.844085    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.844125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.844116    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:40.844253 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.844147    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config-out" (OuterVolumeSpecName: "config-out") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:00:40.844253 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.844178    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.845183 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.845156    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.845183 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.845171    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config" (OuterVolumeSpecName: "config") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.845183 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.845170    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-kube-api-access-4f9gf" (OuterVolumeSpecName: "kube-api-access-4f9gf") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "kube-api-access-4f9gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:40.845356 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.845335    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.845727 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.845702    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.855759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.855728    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-web-config" (OuterVolumeSpecName: "web-config") pod "adc0b190-9ce1-4f5b-9bd3-ac969db768c1" (UID: "adc0b190-9ce1-4f5b-9bd3-ac969db768c1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:40.926565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926532    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd" exitCode=0
Sep 10 21:00:40.926565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926557    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b" exitCode=0
Sep 10 21:00:40.926565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926563    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4" exitCode=0
Sep 10 21:00:40.926565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926569    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea" exitCode=0
Sep 10 21:00:40.926565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926575    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462" exitCode=0
Sep 10 21:00:40.926851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926580    2573 generic.go:356] "Generic (PLEG): container finished" podID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564" exitCode=0
Sep 10 21:00:40.926851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926620    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:40.926851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"}
Sep 10 21:00:40.926851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926773    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"}
Sep 10 21:00:40.926851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"}
Sep 10 21:00:40.926851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926845    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.927045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926863    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"}
Sep 10 21:00:40.927045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"}
Sep 10 21:00:40.927045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"}
Sep 10 21:00:40.927045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.926991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"adc0b190-9ce1-4f5b-9bd3-ac969db768c1","Type":"ContainerDied","Data":"642e4de9cacf9fe83692169c55a0d1fc2a8e47dcf992013ed0c6d612caa678e8"}
Sep 10 21:00:40.935643 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.935589    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:40.936536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936476    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936502    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936520    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-kube-rbac-proxy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936531    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f9gf\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-kube-api-access-4f9gf\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936543    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-web-config\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936555    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config-out\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936563    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936572    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-metrics-client-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936580    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936589    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-grpc-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936596    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936606    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936616    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-db\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936628    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936637    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936647    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-config\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936655    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.936731 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.936663    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc0b190-9ce1-4f5b-9bd3-ac969db768c1-tls-assets\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:00:40.937261 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.937246    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.944871 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.944855    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.952157 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.952127    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 21:00:40.952332 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.952311    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.959535 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.959505    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 21:00:40.960945 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.960925    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.967764 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.967746    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.975154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.975135    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.982134 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.982115    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.982480 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.982458    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.982596 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.982489    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"} err="failed to get container status \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist"
Sep 10 21:00:40.982771 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.982627    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.983154 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.983123    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.983249 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.983160    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"} err="failed to get container status \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist"
Sep 10 21:00:40.983249 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.983183    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.983770 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.983745    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.983853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.983778    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"} err="failed to get container status \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist"
Sep 10 21:00:40.983853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.983800    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.984079 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.984050    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.984138 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.984084    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"} err="failed to get container status \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist"
Sep 10 21:00:40.984138 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.984099    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.984375 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.984358    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.984445 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.984380    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"} err="failed to get container status \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist"
Sep 10 21:00:40.984445 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.984413    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.984703 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.984682    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.984793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.984706    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"} err="failed to get container status \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist"
Sep 10 21:00:40.984793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.984729    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.985047 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:00:40.985029    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.985101 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985051    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"} err="failed to get container status \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist"
Sep 10 21:00:40.985101 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985066    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.985167 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985153    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 21:00:40.985318 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985300    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"} err="failed to get container status \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist"
Sep 10 21:00:40.985359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985319    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.985504 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985489    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-web"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985505    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-web"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985513    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="thanos-sidecar"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985519    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="thanos-sidecar"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985528    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="prometheus"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985536    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="prometheus"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985545    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-thanos"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985554    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-thanos"
Sep 10 21:00:40.985581 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985581    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="config-reloader"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985589    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="config-reloader"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985602    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985603    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"} err="failed to get container status \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985632    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985612    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985692    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="init-config-reloader"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985702    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="init-config-reloader"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985930    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"} err="failed to get container status \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985953    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985959    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-web"
Sep 10 21:00:40.985979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985976    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="prometheus"
Sep 10 21:00:40.986485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985990    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="thanos-sidecar"
Sep 10 21:00:40.986485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.985998    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy"
Sep 10 21:00:40.986485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986007    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="kube-rbac-proxy-thanos"
Sep 10 21:00:40.986485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986017    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" containerName="config-reloader"
Sep 10 21:00:40.986485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986272    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"} err="failed to get container status \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist"
Sep 10 21:00:40.986485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986302    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.986691 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986623    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"} err="failed to get container status \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist"
Sep 10 21:00:40.986691 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986639    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.986896 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986875    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"} err="failed to get container status \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist"
Sep 10 21:00:40.986896 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.986896    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.987158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987141    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"} err="failed to get container status \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist"
Sep 10 21:00:40.987208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987158    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.987435 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987393    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"} err="failed to get container status \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist"
Sep 10 21:00:40.987495 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987451    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.987705 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987689    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"} err="failed to get container status \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist"
Sep 10 21:00:40.987751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987704    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.987941 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987921    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"} err="failed to get container status \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist"
Sep 10 21:00:40.987985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.987942    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.988174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988156    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"} err="failed to get container status \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist"
Sep 10 21:00:40.988248 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988175    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.988460 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988443    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"} err="failed to get container status \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist"
Sep 10 21:00:40.988507 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988461    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.988684 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988666    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"} err="failed to get container status \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist"
Sep 10 21:00:40.988730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988685    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.988931 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988913    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"} err="failed to get container status \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist"
Sep 10 21:00:40.989001 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.988933    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.989161 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989146    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"} err="failed to get container status \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist"
Sep 10 21:00:40.989210 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989160    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.989386 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989367    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"} err="failed to get container status \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist"
Sep 10 21:00:40.989448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989386    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.989639 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989622    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"} err="failed to get container status \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist"
Sep 10 21:00:40.989687 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989639    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.989897 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989879    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"} err="failed to get container status \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist"
Sep 10 21:00:40.989967 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.989906    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.990045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:40.990137 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990107    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"} err="failed to get container status \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist"
Sep 10 21:00:40.990137 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990132    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.990625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990599    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"} err="failed to get container status \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist"
Sep 10 21:00:40.990722 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990649    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.990915 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990893    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"} err="failed to get container status \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist"
Sep 10 21:00:40.990973 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.990918    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.991155 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991137    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"} err="failed to get container status \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist"
Sep 10 21:00:40.991207 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991155    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.991449 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991425    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"} err="failed to get container status \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist"
Sep 10 21:00:40.991449 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991447    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.991710 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991690    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"} err="failed to get container status \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist"
Sep 10 21:00:40.991710 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991710    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.991975 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991957    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"} err="failed to get container status \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist"
Sep 10 21:00:40.992043 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.991975    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.992339 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992319    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"} err="failed to get container status \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist"
Sep 10 21:00:40.992339 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992338    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.992530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 21:00:40.992530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 21:00:40.992530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992442    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 21:00:40.992757 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992727    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"} err="failed to get container status \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist"
Sep 10 21:00:40.992818 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992761    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.993024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992865    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 21:00:40.993024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992939    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 21:00:40.993024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 21:00:40.993024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992958    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 21:00:40.993024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.992971    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 21:00:40.993257 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993086    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"} err="failed to get container status \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist"
Sep 10 21:00:40.993257 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993106    2573 scope.go:117] "RemoveContainer" containerID="8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"
Sep 10 21:00:40.993257 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993228    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 21:00:40.993434 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993296    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kcff9\""
Sep 10 21:00:40.993434 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 21:00:40.993434 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993392    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd"} err="failed to get container status \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": rpc error: code = NotFound desc = could not find container \"8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd\": container with ID starting with 8e07f4b1d264c28713812b03bd0ad98704e4f47a050141940e8555f65b7484fd not found: ID does not exist"
Sep 10 21:00:40.994105 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.993433    2573 scope.go:117] "RemoveContainer" containerID="af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"
Sep 10 21:00:40.994105 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.994039    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 21:00:40.994105 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.994070    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 21:00:40.994928 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.994715    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4vvinnrp4q76b\""
Sep 10 21:00:40.995486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.995456    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b"} err="failed to get container status \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": rpc error: code = NotFound desc = could not find container \"af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b\": container with ID starting with af1aaa80d2991084d2b874a836f22afd370cfc522ebb2782587b7be57ef9b07b not found: ID does not exist"
Sep 10 21:00:40.995589 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.995488    2573 scope.go:117] "RemoveContainer" containerID="050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"
Sep 10 21:00:40.996242 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.996206    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4"} err="failed to get container status \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": rpc error: code = NotFound desc = could not find container \"050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4\": container with ID starting with 050eb93222754806b176aa8bb9247719d8b23f38bc54fcf3fce375642f1cb3a4 not found: ID does not exist"
Sep 10 21:00:40.996336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.996272    2573 scope.go:117] "RemoveContainer" containerID="b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.996626    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea"} err="failed to get container status \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": rpc error: code = NotFound desc = could not find container \"b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea\": container with ID starting with b32d923257549543ecf838b7abcf6098fd738873951320eef19ac044d8b787ea not found: ID does not exist"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.996652    2573 scope.go:117] "RemoveContainer" containerID="e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.997152    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462"} err="failed to get container status \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": rpc error: code = NotFound desc = could not find container \"e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462\": container with ID starting with e65994ab1f5f653eeade4c63081d9aa8dec386fa41fede0693a22e2ae9a97462 not found: ID does not exist"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.997311    2573 scope.go:117] "RemoveContainer" containerID="75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.997878    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564"} err="failed to get container status \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": rpc error: code = NotFound desc = could not find container \"75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564\": container with ID starting with 75b7eaaaf5c2cbc8ebbbc81e848a41c471a0738e937918a8835807777a315564 not found: ID does not exist"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.997901    2573 scope.go:117] "RemoveContainer" containerID="82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"
Sep 10 21:00:40.999862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:40.998243    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76"} err="failed to get container status \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": rpc error: code = NotFound desc = could not find container \"82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76\": container with ID starting with 82e9c247b3e2bbc8aba09daf0ca3a9dd2f0507b9e3a3345e1f6c90120ffecf76 not found: ID does not exist"
Sep 10 21:00:41.004527 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.003928    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 21:00:41.006428 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.006372    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 21:00:41.006802 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.006784    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 21:00:41.037238 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037238 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21cb227e-0482-44bf-a5ca-83c2cddc8322-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037238 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037288    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037306    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-web-config\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037465 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-config\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037584    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvgg\" (UniqueName: \"kubernetes.io/projected/21cb227e-0482-44bf-a5ca-83c2cddc8322-kube-api-access-zdvgg\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.037728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.037723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21cb227e-0482-44bf-a5ca-83c2cddc8322-config-out\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-config\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvgg\" (UniqueName: \"kubernetes.io/projected/21cb227e-0482-44bf-a5ca-83c2cddc8322-kube-api-access-zdvgg\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138646    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138686    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.138737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138711    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138754    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21cb227e-0482-44bf-a5ca-83c2cddc8322-config-out\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21cb227e-0482-44bf-a5ca-83c2cddc8322-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.138983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139542 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139542 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-web-config\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139542 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139542 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139542 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.139782 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.139742    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.140624 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.140594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.141710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-web-config\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.141814    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.141922    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21cb227e-0482-44bf-a5ca-83c2cddc8322-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.141995    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142435 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.142190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142435 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.142359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.142942 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.142862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.143173 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.143145    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.143754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.143734    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-config\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.144371 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.144353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21cb227e-0482-44bf-a5ca-83c2cddc8322-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.144494 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.144473    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.144683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.144665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21cb227e-0482-44bf-a5ca-83c2cddc8322-config-out\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.144745 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.144680    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.144745 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.144710    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21cb227e-0482-44bf-a5ca-83c2cddc8322-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.146951 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.146935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvgg\" (UniqueName: \"kubernetes.io/projected/21cb227e-0482-44bf-a5ca-83c2cddc8322-kube-api-access-zdvgg\") pod \"prometheus-k8s-0\" (UID: \"21cb227e-0482-44bf-a5ca-83c2cddc8322\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.307395 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.307306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:41.592754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.592729    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 21:00:41.594338 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:00:41.594312    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cb227e_0482_44bf_a5ca_83c2cddc8322.slice/crio-77895444a18617345682e3fc310d1cddb2f779bcb6ac4a9f467c465756ec7d60 WatchSource:0}: Error finding container 77895444a18617345682e3fc310d1cddb2f779bcb6ac4a9f467c465756ec7d60: Status 404 returned error can't find the container with id 77895444a18617345682e3fc310d1cddb2f779bcb6ac4a9f467c465756ec7d60
Sep 10 21:00:41.935700 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.935607    2573 generic.go:356] "Generic (PLEG): container finished" podID="21cb227e-0482-44bf-a5ca-83c2cddc8322" containerID="98d2cf93685862b444a2dfc16cee7690fd0150e4ff011e9fa9795fd29ff5f75d" exitCode=0
Sep 10 21:00:41.935857 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.935690    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerDied","Data":"98d2cf93685862b444a2dfc16cee7690fd0150e4ff011e9fa9795fd29ff5f75d"}
Sep 10 21:00:41.935857 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:41.935768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"77895444a18617345682e3fc310d1cddb2f779bcb6ac4a9f467c465756ec7d60"}
Sep 10 21:00:42.043072 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.043032    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc0b190-9ce1-4f5b-9bd3-ac969db768c1" path="/var/lib/kubelet/pods/adc0b190-9ce1-4f5b-9bd3-ac969db768c1/volumes"
Sep 10 21:00:42.944889 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.944847    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"068eaf0adfeb95a7379a6f049eb552c2b9b4e10f7a471cfc302d98acbee1209a"}
Sep 10 21:00:42.945528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.944950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"c0d21989e82247b3041359c73a0311f2065d1555081a6b6bb4a759a73f4b76b3"}
Sep 10 21:00:42.945528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.944986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"5ec6c56fbded793d053aa72cb27de58a2ba938a08c27995e8fe002749bc9b8d0"}
Sep 10 21:00:42.945528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.945011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"a6ca8ece75bdaf6b4b5d95706eb5de91b93eb4780bbcc8051fe5559f0ac4d64c"}
Sep 10 21:00:42.945528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.945044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"ffaa55225f53dfa9a4c75f2bfc7f382b568140a4f4b99c4fd969d5815a2015a5"}
Sep 10 21:00:42.945528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.945068    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21cb227e-0482-44bf-a5ca-83c2cddc8322","Type":"ContainerStarted","Data":"04a777fc6daddffca42d92e06dc82d7f6843c5cae5ad3680e32f89e12702497f"}
Sep 10 21:00:42.976007 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:42.975940    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.956395485 podStartE2EDuration="2.975915769s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.520284ms" isStatefulPod=false podCreationTimestamp="2026-09-10 21:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:00:42.974641586 +0000 UTC m=+165.408471579" watchObservedRunningTime="2026-09-10 21:00:42.975915769 +0000 UTC m=+165.409745719"
Sep 10 21:00:43.935523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:43.935489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:43.987024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:43.986994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:46.307616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:46.307577    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:00:48.485182 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:48.485138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:48.585647 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:48.585611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:52.012683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:52.012601    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:52.112880 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:52.112847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:00:52.166249 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:00:52.166213    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:17.852733 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:17.852695    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:17.955727 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:17.955694    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:22.823235 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:22.823196    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:22.875051 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:22.875018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:23.432990 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:23.432956    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:23.485847 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:23.485815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:37.157970 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:37.157929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:39.465210 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:39.465168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:40.293991 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:40.293954    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:41.308320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:41.308272    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:01:41.324922 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:41.324893    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:01:42.199657 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:42.199620    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 21:01:43.073817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:43.073777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:43.174115 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:43.174077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:45.202648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:45.202605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:45.296514 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:45.296468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:45.928446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:45.928408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:46.056802 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:46.056768    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:47.194139 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:47.194092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:47.571995 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:47.571966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:50.071751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:50.071713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:50.129700 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:50.129665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:52.999088 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:52.999037    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:53.055143 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:53.055107    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:55.782969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:55.782931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:56.688866 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:56.688828    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:56.778045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:56.778007    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:01:58.704723 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.704689    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"]
Sep 10 21:01:58.706985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.706964    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:58.709590 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.709565    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:01:58.709728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.709616    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 21:01:58.710528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.710513    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mrjjc\""
Sep 10 21:01:58.717462 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.717439    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"]
Sep 10 21:01:58.844105 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.844061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfln\" (UniqueName: \"kubernetes.io/projected/4615ecbc-07de-467b-9cff-484978fef78b-kube-api-access-fdfln\") pod \"openshift-lws-operator-fd8ccff4c-fcs62\" (UID: \"4615ecbc-07de-467b-9cff-484978fef78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:58.844105 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.844105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4615ecbc-07de-467b-9cff-484978fef78b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fcs62\" (UID: \"4615ecbc-07de-467b-9cff-484978fef78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:58.944726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.944692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4615ecbc-07de-467b-9cff-484978fef78b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fcs62\" (UID: \"4615ecbc-07de-467b-9cff-484978fef78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:58.944824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.944809    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfln\" (UniqueName: \"kubernetes.io/projected/4615ecbc-07de-467b-9cff-484978fef78b-kube-api-access-fdfln\") pod \"openshift-lws-operator-fd8ccff4c-fcs62\" (UID: \"4615ecbc-07de-467b-9cff-484978fef78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:58.945135 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.945113    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4615ecbc-07de-467b-9cff-484978fef78b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fcs62\" (UID: \"4615ecbc-07de-467b-9cff-484978fef78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:58.952336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:58.952305    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfln\" (UniqueName: \"kubernetes.io/projected/4615ecbc-07de-467b-9cff-484978fef78b-kube-api-access-fdfln\") pod \"openshift-lws-operator-fd8ccff4c-fcs62\" (UID: \"4615ecbc-07de-467b-9cff-484978fef78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:59.017365 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:59.017263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"
Sep 10 21:01:59.284271 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:01:59.284244    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62"]
Sep 10 21:01:59.286681 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:01:59.286647    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4615ecbc_07de_467b_9cff_484978fef78b.slice/crio-79a231a68be0a2f6e724490a788df7f5230dc1de084299a300abf43bedabf614 WatchSource:0}: Error finding container 79a231a68be0a2f6e724490a788df7f5230dc1de084299a300abf43bedabf614: Status 404 returned error can't find the container with id 79a231a68be0a2f6e724490a788df7f5230dc1de084299a300abf43bedabf614
Sep 10 21:02:00.254363 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:00.254321    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62" event={"ID":"4615ecbc-07de-467b-9cff-484978fef78b","Type":"ContainerStarted","Data":"79a231a68be0a2f6e724490a788df7f5230dc1de084299a300abf43bedabf614"}
Sep 10 21:02:02.264791 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:02.264706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62" event={"ID":"4615ecbc-07de-467b-9cff-484978fef78b","Type":"ContainerStarted","Data":"dc741cfd00f32c19bf779ecf440762d55b94d3c1002cba87521a228c3bd662f4"}
Sep 10 21:02:02.298840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:02.298786    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcs62" podStartSLOduration=1.727108691 podStartE2EDuration="4.298765767s" totalImagesPullingTime="2.571657076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:02.29726774 +0000 UTC m=+244.731097693" watchObservedRunningTime="2026-09-10 21:02:02.298765767 +0000 UTC m=+244.732595715"
Sep 10 21:02:03.083676 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:03.083632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:03.184338 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:03.184299    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:05.198140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:05.198105    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:17.586832 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:17.586793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:17.673546 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:17.673507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:18.238528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.238492    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:18.473451 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.473418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:18.576727 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.576676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:18.618714 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.618681    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"]
Sep 10 21:02:18.626900 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.626871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.630217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.630192    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 21:02:18.630217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.630216    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 21:02:18.630531 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.630511    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 21:02:18.630781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.630636    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pmkvq\""
Sep 10 21:02:18.630781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.630673    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 21:02:18.643144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.643113    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"]
Sep 10 21:02:18.717035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.717006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f936dc0e-86e3-48d8-8105-c449399efc31-manifests\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.717216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.717043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f936dc0e-86e3-48d8-8105-c449399efc31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.717216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.717069    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f936dc0e-86e3-48d8-8105-c449399efc31-tmp\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.717216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.717093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhtq\" (UniqueName: \"kubernetes.io/projected/f936dc0e-86e3-48d8-8105-c449399efc31-kube-api-access-nlhtq\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.717216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.717149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f936dc0e-86e3-48d8-8105-c449399efc31-webhook-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.723308 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.723280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:18.818005 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.817965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f936dc0e-86e3-48d8-8105-c449399efc31-webhook-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.818207 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.818029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f936dc0e-86e3-48d8-8105-c449399efc31-manifests\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.818207 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.818055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f936dc0e-86e3-48d8-8105-c449399efc31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.818207 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.818077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f936dc0e-86e3-48d8-8105-c449399efc31-tmp\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.818207 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.818094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhtq\" (UniqueName: \"kubernetes.io/projected/f936dc0e-86e3-48d8-8105-c449399efc31-kube-api-access-nlhtq\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.818550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.818515    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f936dc0e-86e3-48d8-8105-c449399efc31-manifests\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.820372 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.820339    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f936dc0e-86e3-48d8-8105-c449399efc31-tmp\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.820709 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.820687    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f936dc0e-86e3-48d8-8105-c449399efc31-webhook-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.820758 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.820689    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f936dc0e-86e3-48d8-8105-c449399efc31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.829482 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.829430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhtq\" (UniqueName: \"kubernetes.io/projected/f936dc0e-86e3-48d8-8105-c449399efc31-kube-api-access-nlhtq\") pod \"opendatahub-operator-controller-manager-d855cccc6-fw2lm\" (UID: \"f936dc0e-86e3-48d8-8105-c449399efc31\") " pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.839570 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.839546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:18.937299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.937262    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:18.939806 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:18.939781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:19.040097 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:19.040064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:19.142500 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:19.142421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:19.215981 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:19.215959    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"]
Sep 10 21:02:19.217361 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:19.217339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:19.218219 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:02:19.218199    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf936dc0e_86e3_48d8_8105_c449399efc31.slice/crio-418606a73c92cc902e4db8ea7c22d2604f335aa19bcf75f42b9a0258bcebfa8e WatchSource:0}: Error finding container 418606a73c92cc902e4db8ea7c22d2604f335aa19bcf75f42b9a0258bcebfa8e: Status 404 returned error can't find the container with id 418606a73c92cc902e4db8ea7c22d2604f335aa19bcf75f42b9a0258bcebfa8e
Sep 10 21:02:19.335412 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:19.335374    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm" event={"ID":"f936dc0e-86e3-48d8-8105-c449399efc31","Type":"ContainerStarted","Data":"418606a73c92cc902e4db8ea7c22d2604f335aa19bcf75f42b9a0258bcebfa8e"}
Sep 10 21:02:23.354840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:23.354803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm" event={"ID":"f936dc0e-86e3-48d8-8105-c449399efc31","Type":"ContainerStarted","Data":"66fbe91a59bf596209ea7dca209506d09a18ac87c9fde966f405ca3938d85214"}
Sep 10 21:02:24.361105 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:24.361072    2573 generic.go:356] "Generic (PLEG): container finished" podID="f936dc0e-86e3-48d8-8105-c449399efc31" containerID="66fbe91a59bf596209ea7dca209506d09a18ac87c9fde966f405ca3938d85214" exitCode=0
Sep 10 21:02:24.361519 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:24.361126    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm" event={"ID":"f936dc0e-86e3-48d8-8105-c449399efc31","Type":"ContainerDied","Data":"66fbe91a59bf596209ea7dca209506d09a18ac87c9fde966f405ca3938d85214"}
Sep 10 21:02:25.367173 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:25.367138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm" event={"ID":"f936dc0e-86e3-48d8-8105-c449399efc31","Type":"ContainerStarted","Data":"faa7096934f47dbe48249d8408b71652d19817d21725bcbf271bc5b05f000f73"}
Sep 10 21:02:25.367620 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:25.367268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:25.459657 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:25.459621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:25.562534 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:25.562506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:29.056331 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:29.056296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:29.156261 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:29.156223    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:36.373413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:36.373368    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm"
Sep 10 21:02:36.394883 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:36.394830    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d855cccc6-fw2lm" podStartSLOduration=13.890651342 podStartE2EDuration="18.394812328s" totalImagesPullingTime="3.455156947s" totalInitContainerRuntime="1.049004039s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:25.393329232 +0000 UTC m=+267.827159200" watchObservedRunningTime="2026-09-10 21:02:36.394812328 +0000 UTC m=+278.828642277"
Sep 10 21:02:37.946148 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:37.946111    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:38.056544 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.056495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:38.276885 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.276799    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:38.302089 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.302055    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-767744946f-qhd87"]
Sep 10 21:02:38.307603 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.307574    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.310095 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.310071    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 21:02:38.310217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.310104    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 21:02:38.310217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.310178    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 21:02:38.310305 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.310260    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 21:02:38.310878 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.310864    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g5wjx\""
Sep 10 21:02:38.317225 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.317197    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-767744946f-qhd87"]
Sep 10 21:02:38.409037 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.408995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tmp\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.409037 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.409036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v8sw\" (UniqueName: \"kubernetes.io/projected/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-kube-api-access-7v8sw\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.409260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.409105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tls-certs\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.510084 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.510034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tls-certs\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.510290 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.510166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tmp\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.510290 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:02:38.510187    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 21:02:38.510290 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:02:38.510265    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tls-certs podName:0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50 nodeName:}" failed. No retries permitted until 2026-09-10 21:02:39.010246371 +0000 UTC m=+281.444076302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tls-certs") pod "kube-auth-proxy-767744946f-qhd87" (UID: "0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50") : secret "kube-auth-proxy-tls" not found
Sep 10 21:02:38.510497 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.510190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v8sw\" (UniqueName: \"kubernetes.io/projected/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-kube-api-access-7v8sw\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.512485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.512464    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tmp\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.519236 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.519208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v8sw\" (UniqueName: \"kubernetes.io/projected/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-kube-api-access-7v8sw\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:38.570319 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:38.570287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:39.014542 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.014442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tls-certs\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:39.017081 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.017056    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50-tls-certs\") pod \"kube-auth-proxy-767744946f-qhd87\" (UID: \"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50\") " pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:39.218851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.218812    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87"
Sep 10 21:02:39.493205 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.493177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-767744946f-qhd87"]
Sep 10 21:02:39.494752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.494723    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"]
Sep 10 21:02:39.496042 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:02:39.496003    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b962bcb_0ceb_44b6_b2cf_2f34fc5e1f50.slice/crio-7c0ad1db025bdeab727042b7ca234ef56313e6c05bf40cf7aab6b9d821579130 WatchSource:0}: Error finding container 7c0ad1db025bdeab727042b7ca234ef56313e6c05bf40cf7aab6b9d821579130: Status 404 returned error can't find the container with id 7c0ad1db025bdeab727042b7ca234ef56313e6c05bf40cf7aab6b9d821579130
Sep 10 21:02:39.496206 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.496185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:39.497805 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.497788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.500264 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.500241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 21:02:39.500367 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.500271    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 21:02:39.500367 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.500353    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dh2tc\""
Sep 10 21:02:39.500485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.500245    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:02:39.500579 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.500545    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 21:02:39.512389 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.512357    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"]
Sep 10 21:02:39.586860 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.586832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:39.619649 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.619851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvl42\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-kube-api-access-fvl42\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.619851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619776    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced99ab5-c2dd-47c8-8f31-4d6028de426e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.619851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.620044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619867    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.620044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.620044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.619907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.720832 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.720792    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.720842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.720959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.721045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.721094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721214 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.721170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvl42\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-kube-api-access-fvl42\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721272 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.721244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced99ab5-c2dd-47c8-8f31-4d6028de426e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.721810 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.721775    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.723475 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.723444    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced99ab5-c2dd-47c8-8f31-4d6028de426e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.723584 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.723499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.723584 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.723563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.723671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.723607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.729047 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.729019    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.729163 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.729125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvl42\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-kube-api-access-fvl42\") pod \"istiod-openshift-gateway-7b7995d5cd-hmj8k\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:39.809238 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:39.809204    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:40.086931 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:40.086844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"]
Sep 10 21:02:40.424663 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:40.424622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:40.433104 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:40.433064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" event={"ID":"ced99ab5-c2dd-47c8-8f31-4d6028de426e","Type":"ContainerStarted","Data":"38e54ba99f0a729051c6213586b23604ed8d4ff5e5afd8dfd3ae26b67089430c"}
Sep 10 21:02:40.434650 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:40.434619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87" event={"ID":"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50","Type":"ContainerStarted","Data":"7c0ad1db025bdeab727042b7ca234ef56313e6c05bf40cf7aab6b9d821579130"}
Sep 10 21:02:42.447595 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:42.447547    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87" event={"ID":"0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50","Type":"ContainerStarted","Data":"c102b027153111f0feed0ea5062c412dece997fc7fe1c2aa39e264523f020e4b"}
Sep 10 21:02:42.465214 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:42.465159    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-767744946f-qhd87" podStartSLOduration=1.974440692 podStartE2EDuration="4.465140214s" totalImagesPullingTime="2.490699522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:42.462914452 +0000 UTC m=+284.896744392" watchObservedRunningTime="2026-09-10 21:02:42.465140214 +0000 UTC m=+284.898970215"
Sep 10 21:02:43.847236 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:43.847191    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:02:43.847646 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:43.847277    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:02:44.465479 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:44.465441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" event={"ID":"ced99ab5-c2dd-47c8-8f31-4d6028de426e","Type":"ContainerStarted","Data":"bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d"}
Sep 10 21:02:44.465687 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:44.465655    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:44.467616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:44.467587    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-hmj8k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:02:44.467746 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:44.467632    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:02:44.485388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:44.485334    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" podStartSLOduration=1.735243987 podStartE2EDuration="5.48531679s" totalImagesPullingTime="3.750072803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:44.483440827 +0000 UTC m=+286.917270775" watchObservedRunningTime="2026-09-10 21:02:44.48531679 +0000 UTC m=+286.919146739"
Sep 10 21:02:45.007527 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.007489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:45.107295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.107247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:45.471203 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.471165    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-hmj8k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:02:45.471420 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.471231    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:02:45.561115 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.561077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:45.760506 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.760419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:45.908054 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:45.908018    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:48.471510 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:48.471480    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:48.941458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:48.941423    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:49.043422 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:49.043364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:49.148512 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:49.148475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:49.449840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:49.449805    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:49.656297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:49.656260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:49.755956 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:49.755867    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:50.775812 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:50.775769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:50.876579 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:50.876544    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:57.976390 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:57.976361    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:02:57.979156 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:57.979127    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:02:57.983448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:57.983424    2573 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 21:02:58.129570 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.129523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:58.262993 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.262910    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6x884"]
Sep 10 21:02:58.265306 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.265287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.268809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.268789    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 21:02:58.269133 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.269116    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2m7nw\""
Sep 10 21:02:58.280123 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.280095    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"]
Sep 10 21:02:58.282113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.282099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:58.286089 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.286069    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7z4k8\""
Sep 10 21:02:58.286699 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.286680    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 21:02:58.291964 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.291942    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6x884"]
Sep 10 21:02:58.293671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.293651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d175112-fd7b-4976-9f61-5e03599b92db-cert\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.293751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.293706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szzln\" (UniqueName: \"kubernetes.io/projected/0d175112-fd7b-4976-9f61-5e03599b92db-kube-api-access-szzln\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.313792 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.313756    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"]
Sep 10 21:02:58.394381 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.394335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsn2d\" (UniqueName: \"kubernetes.io/projected/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-kube-api-access-jsn2d\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:58.394611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.394434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d175112-fd7b-4976-9f61-5e03599b92db-cert\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.394611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.394505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:58.394611 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:02:58.394524    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 21:02:58.394611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.394546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szzln\" (UniqueName: \"kubernetes.io/projected/0d175112-fd7b-4976-9f61-5e03599b92db-kube-api-access-szzln\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.394611 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:02:58.394611    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d175112-fd7b-4976-9f61-5e03599b92db-cert podName:0d175112-fd7b-4976-9f61-5e03599b92db nodeName:}" failed. No retries permitted until 2026-09-10 21:02:58.894587269 +0000 UTC m=+301.328417214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0d175112-fd7b-4976-9f61-5e03599b92db-cert") pod "kserve-controller-manager-d6f4b65b8-6x884" (UID: "0d175112-fd7b-4976-9f61-5e03599b92db") : secret "kserve-webhook-server-cert" not found
Sep 10 21:02:58.406353 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.406321    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szzln\" (UniqueName: \"kubernetes.io/projected/0d175112-fd7b-4976-9f61-5e03599b92db-kube-api-access-szzln\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.495859 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.495814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsn2d\" (UniqueName: \"kubernetes.io/projected/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-kube-api-access-jsn2d\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:58.496025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.495896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:58.496025 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:02:58.495999    2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 21:02:58.496108 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:02:58.496053    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-cert podName:040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5 nodeName:}" failed. No retries permitted until 2026-09-10 21:02:58.996038504 +0000 UTC m=+301.429868431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-cert") pod "llmisvc-controller-manager-777c6bd7d5-7fggj" (UID: "040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5") : secret "llmisvc-webhook-server-cert" not found
Sep 10 21:02:58.508241 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.508207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsn2d\" (UniqueName: \"kubernetes.io/projected/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-kube-api-access-jsn2d\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:58.900494 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.900460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d175112-fd7b-4976-9f61-5e03599b92db-cert\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:58.902837 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:58.902809    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d175112-fd7b-4976-9f61-5e03599b92db-cert\") pod \"kserve-controller-manager-d6f4b65b8-6x884\" (UID: \"0d175112-fd7b-4976-9f61-5e03599b92db\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:59.001024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.000983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:59.003507 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.003483    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7fggj\" (UID: \"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:59.175813 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.175726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:02:59.192548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.192523    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:02:59.451692 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.451668    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6x884"]
Sep 10 21:02:59.452488 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:02:59.452455    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d175112_fd7b_4976_9f61_5e03599b92db.slice/crio-fee08712adbc93931a07ff9cb7ec7602aaf74d0dbd34e169bbd8df9557c37b9c WatchSource:0}: Error finding container fee08712adbc93931a07ff9cb7ec7602aaf74d0dbd34e169bbd8df9557c37b9c: Status 404 returned error can't find the container with id fee08712adbc93931a07ff9cb7ec7602aaf74d0dbd34e169bbd8df9557c37b9c
Sep 10 21:02:59.454605 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.454584    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:02:59.476746 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.476679    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"]
Sep 10 21:02:59.479463 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:02:59.479433    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod040ff9f8_a1f7_4f4c_8b9a_eebaccd518e5.slice/crio-cefeb359f9e4f28f0e477f4c1150fb17726cf35b9b3bba17399ab0afb5ee7526 WatchSource:0}: Error finding container cefeb359f9e4f28f0e477f4c1150fb17726cf35b9b3bba17399ab0afb5ee7526: Status 404 returned error can't find the container with id cefeb359f9e4f28f0e477f4c1150fb17726cf35b9b3bba17399ab0afb5ee7526
Sep 10 21:02:59.482284 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.482248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:59.534078 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.534039    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj" event={"ID":"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5","Type":"ContainerStarted","Data":"cefeb359f9e4f28f0e477f4c1150fb17726cf35b9b3bba17399ab0afb5ee7526"}
Sep 10 21:02:59.535282 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.535250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884" event={"ID":"0d175112-fd7b-4976-9f61-5e03599b92db","Type":"ContainerStarted","Data":"fee08712adbc93931a07ff9cb7ec7602aaf74d0dbd34e169bbd8df9557c37b9c"}
Sep 10 21:02:59.562234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.562197    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:59.592602 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.592570    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"]
Sep 10 21:02:59.592789 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.592767    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerName="discovery" containerID="cri-o://bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d" gracePeriod=30
Sep 10 21:02:59.662573 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.662535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:02:59.824952 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.824922    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:02:59.910413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910366    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-ca-configmap\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910464    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvl42\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-kube-api-access-fvl42\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910495    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced99ab5-c2dd-47c8-8f31-4d6028de426e-local-certs\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910521    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-kubeconfig\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910549    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-token\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-dns-cert\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910595    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-cacerts\") pod \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\" (UID: \"ced99ab5-c2dd-47c8-8f31-4d6028de426e\") "
Sep 10 21:02:59.910990 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.910801    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:02:59.912969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.912934    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ced99ab5-c2dd-47c8-8f31-4d6028de426e-local-certs" (OuterVolumeSpecName: "local-certs") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:59.913112 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.913017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-cacerts" (OuterVolumeSpecName: "cacerts") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:02:59.913229 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.913193    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:02:59.913327 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.913220    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-token" (OuterVolumeSpecName: "istio-token") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:59.913327 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.913247    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-kube-api-access-fvl42" (OuterVolumeSpecName: "kube-api-access-fvl42") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "kube-api-access-fvl42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:59.913327 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:02:59.913271    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ced99ab5-c2dd-47c8-8f31-4d6028de426e" (UID: "ced99ab5-c2dd-47c8-8f31-4d6028de426e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:00.011932 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011840    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.011932 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011880    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-dns-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.011932 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011895    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-cacerts\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.011932 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011909    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-csr-ca-configmap\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.011932 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011922    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvl42\" (UniqueName: \"kubernetes.io/projected/ced99ab5-c2dd-47c8-8f31-4d6028de426e-kube-api-access-fvl42\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.011932 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011935    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ced99ab5-c2dd-47c8-8f31-4d6028de426e-local-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.012683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.011948    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ced99ab5-c2dd-47c8-8f31-4d6028de426e-istio-kubeconfig\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:03:00.543967 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.543927    2573 generic.go:356] "Generic (PLEG): container finished" podID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerID="bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d" exitCode=0
Sep 10 21:03:00.544140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.543993    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"
Sep 10 21:03:00.544140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.544010    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" event={"ID":"ced99ab5-c2dd-47c8-8f31-4d6028de426e","Type":"ContainerDied","Data":"bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d"}
Sep 10 21:03:00.544140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.544064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k" event={"ID":"ced99ab5-c2dd-47c8-8f31-4d6028de426e","Type":"ContainerDied","Data":"38e54ba99f0a729051c6213586b23604ed8d4ff5e5afd8dfd3ae26b67089430c"}
Sep 10 21:03:00.544140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.544090    2573 scope.go:117] "RemoveContainer" containerID="bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d"
Sep 10 21:03:00.580601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.580523    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"]
Sep 10 21:03:00.593383 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.593315    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k"]
Sep 10 21:03:00.679488 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.679470    2573 scope.go:117] "RemoveContainer" containerID="bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d"
Sep 10 21:03:00.679964 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:03:00.679927    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d\": container with ID starting with bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d not found: ID does not exist" containerID="bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d"
Sep 10 21:03:00.680102 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:00.679972    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d"} err="failed to get container status \"bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d\": rpc error: code = NotFound desc = could not find container \"bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d\": container with ID starting with bc1fc7b0f3ec9aaa5e9388d3cfa77b01c364db74d814f7e9a33ec773f04d7a7d not found: ID does not exist"
Sep 10 21:03:02.045067 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:02.045020    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" path="/var/lib/kubelet/pods/ced99ab5-c2dd-47c8-8f31-4d6028de426e/volumes"
Sep 10 21:03:02.558926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:02.558889    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884" event={"ID":"0d175112-fd7b-4976-9f61-5e03599b92db","Type":"ContainerStarted","Data":"c6b9a6c54b3f7f677792a1bd018c97ec1911ae717f4bf2033b7951a8fd286fea"}
Sep 10 21:03:02.559032 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:02.559013    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:03:02.574376 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:02.574330    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884" podStartSLOduration=2.162083772 podStartE2EDuration="4.57430944s" totalImagesPullingTime="2.412225668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:02.573890567 +0000 UTC m=+305.007720516" watchObservedRunningTime="2026-09-10 21:03:02.57430944 +0000 UTC m=+305.008139389"
Sep 10 21:03:03.565155 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:03.565120    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj" event={"ID":"040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5","Type":"ContainerStarted","Data":"d8f8edef3f2bef9037dddde6c195294d6516a3b54561ab5bdccf6953dae873cd"}
Sep 10 21:03:03.565585 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:03.565213    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:03:03.583060 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:03.583008    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj" podStartSLOduration=2.518188063 podStartE2EDuration="5.582993095s" totalImagesPullingTime="3.064805032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:03.581667447 +0000 UTC m=+306.015497396" watchObservedRunningTime="2026-09-10 21:03:03.582993095 +0000 UTC m=+306.016823044"
Sep 10 21:03:33.571014 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:33.570982    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6x884"
Sep 10 21:03:34.572886 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:34.572852    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7fggj"
Sep 10 21:03:49.927282 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:49.927245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:03:49.997184 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:03:49.997150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:03.338375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:03.338339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:05.378469 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.378426    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"]
Sep 10 21:04:05.378963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.378826    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerName="discovery"
Sep 10 21:04:05.378963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.378839    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerName="discovery"
Sep 10 21:04:05.378963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.378895    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced99ab5-c2dd-47c8-8f31-4d6028de426e" containerName="discovery"
Sep 10 21:04:05.381730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.381711    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:05.385484 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.385453    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 21:04:05.385643 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.385546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 21:04:05.385643 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.385556    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4mpfv\""
Sep 10 21:04:05.386358 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.386344    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 21:04:05.394683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.394656    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"]
Sep 10 21:04:05.502611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.502577    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp8pq\" (UniqueName: \"kubernetes.io/projected/4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f-kube-api-access-mp8pq\") pod \"dns-operator-controller-manager-7b84cd7c9c-mjp6q\" (UID: \"4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:05.603976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.603928    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp8pq\" (UniqueName: \"kubernetes.io/projected/4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f-kube-api-access-mp8pq\") pod \"dns-operator-controller-manager-7b84cd7c9c-mjp6q\" (UID: \"4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:05.612482 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.612454    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp8pq\" (UniqueName: \"kubernetes.io/projected/4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f-kube-api-access-mp8pq\") pod \"dns-operator-controller-manager-7b84cd7c9c-mjp6q\" (UID: \"4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:05.692059 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.691959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:05.967741 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:05.967704    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"]
Sep 10 21:04:05.971053 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:05.970982    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e970c7e_01f9_4d9a_90fe_ce8e35b8fa9f.slice/crio-d30e1df20f5de0a592716d50442d410333f454823d38470ec9ae78b1e2909ac9 WatchSource:0}: Error finding container d30e1df20f5de0a592716d50442d410333f454823d38470ec9ae78b1e2909ac9: Status 404 returned error can't find the container with id d30e1df20f5de0a592716d50442d410333f454823d38470ec9ae78b1e2909ac9
Sep 10 21:04:06.133972 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:06.133941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:06.846486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:06.846449    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q" event={"ID":"4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f","Type":"ContainerStarted","Data":"d30e1df20f5de0a592716d50442d410333f454823d38470ec9ae78b1e2909ac9"}
Sep 10 21:04:07.468092 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.468031    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"]
Sep 10 21:04:07.470841 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.470813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:07.474276 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.474252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xs6hb\""
Sep 10 21:04:07.486028 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.485999    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"]
Sep 10 21:04:07.623141 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.623099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjmd7\" (UniqueName: \"kubernetes.io/projected/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75-kube-api-access-qjmd7\") pod \"limitador-operator-controller-manager-74495c69f8-5tqwg\" (UID: \"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:07.724413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.724299    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjmd7\" (UniqueName: \"kubernetes.io/projected/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75-kube-api-access-qjmd7\") pod \"limitador-operator-controller-manager-74495c69f8-5tqwg\" (UID: \"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:07.743953 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.743885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjmd7\" (UniqueName: \"kubernetes.io/projected/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75-kube-api-access-qjmd7\") pod \"limitador-operator-controller-manager-74495c69f8-5tqwg\" (UID: \"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:07.788587 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.788551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:07.793765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.793735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:07.921759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:07.921706    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:08.618595 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:08.618563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:08.858039 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:08.858005    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q" event={"ID":"4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f","Type":"ContainerStarted","Data":"b37ba02ebb6539087f9763fa5cbbc9f08fff8c851beebe6e8f5daef494728df7"}
Sep 10 21:04:08.858208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:08.858158    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:08.881286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:08.881183    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q" podStartSLOduration=1.084643887 podStartE2EDuration="3.881168221s" totalImagesPullingTime="2.796524334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:08.879361378 +0000 UTC m=+371.313191328" watchObservedRunningTime="2026-09-10 21:04:08.881168221 +0000 UTC m=+371.314998161"
Sep 10 21:04:08.928462 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:08.928426    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:09.012619 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:09.012590    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"]
Sep 10 21:04:09.014738 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:09.014708    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbd16ef_1ac9_4ade_8064_64ec4e0dcb75.slice/crio-84e7398edb5a0b0944337e068285bc3bc89f500d697d7bc6a2883ba3fda18e64 WatchSource:0}: Error finding container 84e7398edb5a0b0944337e068285bc3bc89f500d697d7bc6a2883ba3fda18e64: Status 404 returned error can't find the container with id 84e7398edb5a0b0944337e068285bc3bc89f500d697d7bc6a2883ba3fda18e64
Sep 10 21:04:09.186067 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:09.185850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:09.863745 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:09.863709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg" event={"ID":"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75","Type":"ContainerStarted","Data":"84e7398edb5a0b0944337e068285bc3bc89f500d697d7bc6a2883ba3fda18e64"}
Sep 10 21:04:10.072547 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:10.072516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:10.169928 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:10.169835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:11.873709 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:11.873670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg" event={"ID":"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75","Type":"ContainerStarted","Data":"ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6"}
Sep 10 21:04:11.874140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:11.873833    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:11.901185 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:11.901124    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg" podStartSLOduration=3.062194178 podStartE2EDuration="4.901106348s" totalImagesPullingTime="1.83891217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:11.899016122 +0000 UTC m=+374.332846072" watchObservedRunningTime="2026-09-10 21:04:11.901106348 +0000 UTC m=+374.334936296"
Sep 10 21:04:12.019682 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.019647    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"]
Sep 10 21:04:12.022214 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.022185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.025323 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.025303    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f24fn\""
Sep 10 21:04:12.045586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.045553    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"]
Sep 10 21:04:12.169316 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.169184    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b501a7f-54e1-4369-8d73-3074c90a4bef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.169530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.169410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbwlg\" (UniqueName: \"kubernetes.io/projected/4b501a7f-54e1-4369-8d73-3074c90a4bef-kube-api-access-tbwlg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.189780 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.189718    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:12.270830 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.270786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbwlg\" (UniqueName: \"kubernetes.io/projected/4b501a7f-54e1-4369-8d73-3074c90a4bef-kube-api-access-tbwlg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.271013 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.270852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b501a7f-54e1-4369-8d73-3074c90a4bef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.271186 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.271169    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b501a7f-54e1-4369-8d73-3074c90a4bef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.279858 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.279823    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbwlg\" (UniqueName: \"kubernetes.io/projected/4b501a7f-54e1-4369-8d73-3074c90a4bef-kube-api-access-tbwlg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.332716 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.332676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:12.518521 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.518441    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:12.607521 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.607488    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"]
Sep 10 21:04:12.610930 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:12.610902    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b501a7f_54e1_4369_8d73_3074c90a4bef.slice/crio-d45e02e6fb21caaeb6bf627e37834f19fb10219d0fca377b3bf699362dc2e9f0 WatchSource:0}: Error finding container d45e02e6fb21caaeb6bf627e37834f19fb10219d0fca377b3bf699362dc2e9f0: Status 404 returned error can't find the container with id d45e02e6fb21caaeb6bf627e37834f19fb10219d0fca377b3bf699362dc2e9f0
Sep 10 21:04:12.880204 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:12.880168    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf" event={"ID":"4b501a7f-54e1-4369-8d73-3074c90a4bef","Type":"ContainerStarted","Data":"d45e02e6fb21caaeb6bf627e37834f19fb10219d0fca377b3bf699362dc2e9f0"}
Sep 10 21:04:13.973765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:13.973714    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:14.402501 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.402462    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-89snh"]
Sep 10 21:04:14.405170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.405148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:14.407848 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.407821    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zjgfq\""
Sep 10 21:04:14.417134 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.417103    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-89snh"]
Sep 10 21:04:14.489844 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.489800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cbh\" (UniqueName: \"kubernetes.io/projected/e64caa1a-1998-43a7-9e06-a1bf77b96434-kube-api-access-k5cbh\") pod \"authorino-operator-76b478bd78-89snh\" (UID: \"e64caa1a-1998-43a7-9e06-a1bf77b96434\") " pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:14.590532 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.590493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cbh\" (UniqueName: \"kubernetes.io/projected/e64caa1a-1998-43a7-9e06-a1bf77b96434-kube-api-access-k5cbh\") pod \"authorino-operator-76b478bd78-89snh\" (UID: \"e64caa1a-1998-43a7-9e06-a1bf77b96434\") " pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:14.602803 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.602765    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cbh\" (UniqueName: \"kubernetes.io/projected/e64caa1a-1998-43a7-9e06-a1bf77b96434-kube-api-access-k5cbh\") pod \"authorino-operator-76b478bd78-89snh\" (UID: \"e64caa1a-1998-43a7-9e06-a1bf77b96434\") " pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:14.718842 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:14.718749    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:15.012910 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:15.012863    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-89snh"]
Sep 10 21:04:15.016320 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:15.016277    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64caa1a_1998_43a7_9e06_a1bf77b96434.slice/crio-ec1ed107fd7b8a9541a18f2bd0ea8ebf46d246e1c5e1982090a7239050f40158 WatchSource:0}: Error finding container ec1ed107fd7b8a9541a18f2bd0ea8ebf46d246e1c5e1982090a7239050f40158: Status 404 returned error can't find the container with id ec1ed107fd7b8a9541a18f2bd0ea8ebf46d246e1c5e1982090a7239050f40158
Sep 10 21:04:15.899717 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:15.899670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-89snh" event={"ID":"e64caa1a-1998-43a7-9e06-a1bf77b96434","Type":"ContainerStarted","Data":"ec1ed107fd7b8a9541a18f2bd0ea8ebf46d246e1c5e1982090a7239050f40158"}
Sep 10 21:04:15.945894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:15.945858    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:16.041301 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:16.041263    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:16.907562 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:16.907517    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf" event={"ID":"4b501a7f-54e1-4369-8d73-3074c90a4bef","Type":"ContainerStarted","Data":"7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17"}
Sep 10 21:04:16.907732 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:16.907640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:16.930068 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:16.930009    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf" podStartSLOduration=1.848157993 podStartE2EDuration="5.929988323s" totalImagesPullingTime="4.08183033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:16.927569254 +0000 UTC m=+379.361399204" watchObservedRunningTime="2026-09-10 21:04:16.929988323 +0000 UTC m=+379.363818273"
Sep 10 21:04:17.915089 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:17.915039    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-89snh" event={"ID":"e64caa1a-1998-43a7-9e06-a1bf77b96434","Type":"ContainerStarted","Data":"ca647e1d22cb10cc0d8dcb36589670d9bc609ec9247e2f7fd52a1f275e66b618"}
Sep 10 21:04:17.933024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:17.932973    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-89snh" podStartSLOduration=1.572986503 podStartE2EDuration="3.932954259s" totalImagesPullingTime="2.359967756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:17.930765735 +0000 UTC m=+380.364595683" watchObservedRunningTime="2026-09-10 21:04:17.932954259 +0000 UTC m=+380.366784208"
Sep 10 21:04:18.920473 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:18.920437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:19.535813 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:19.535757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.608638 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:19.608598    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.825111 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:19.825074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:19.866174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:19.866145    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mjp6q"
Sep 10 21:04:19.925715 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:19.925666    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:20.029899 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:20.029863    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:21.871049 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:21.871019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:21.935863 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:21.935810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:22.882426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:22.882384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:23.530811 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:23.530765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:23.623820 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:23.623780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:27.918150 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:27.918122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:29.301031 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.300997    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"]
Sep 10 21:04:29.304680 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.304659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.324749 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.324708    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"]
Sep 10 21:04:29.428869 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.428830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac75063-f133-42bf-91a7-04297fe1b55c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.429051 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.428887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr4km\" (UniqueName: \"kubernetes.io/projected/fac75063-f133-42bf-91a7-04297fe1b55c-kube-api-access-vr4km\") pod \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.529718 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.529672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac75063-f133-42bf-91a7-04297fe1b55c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.529890 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.529734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4km\" (UniqueName: \"kubernetes.io/projected/fac75063-f133-42bf-91a7-04297fe1b55c-kube-api-access-vr4km\") pod \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.530082 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.530061    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac75063-f133-42bf-91a7-04297fe1b55c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.542032 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.541999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr4km\" (UniqueName: \"kubernetes.io/projected/fac75063-f133-42bf-91a7-04297fe1b55c-kube-api-access-vr4km\") pod \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.615751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.615715    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:29.917053 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.917025    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"]
Sep 10 21:04:29.921107 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:29.921067    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac75063_f133_42bf_91a7_04297fe1b55c.slice/crio-2d203a6763f39a14a8ab24380a1047d2e4cd4dfcd0eda3b206fa36d14d8ce59e WatchSource:0}: Error finding container 2d203a6763f39a14a8ab24380a1047d2e4cd4dfcd0eda3b206fa36d14d8ce59e: Status 404 returned error can't find the container with id 2d203a6763f39a14a8ab24380a1047d2e4cd4dfcd0eda3b206fa36d14d8ce59e
Sep 10 21:04:29.927081 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.927053    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-89snh"
Sep 10 21:04:29.950297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.950265    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"]
Sep 10 21:04:29.976942 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.976857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn" event={"ID":"fac75063-f133-42bf-91a7-04297fe1b55c","Type":"ContainerStarted","Data":"2d203a6763f39a14a8ab24380a1047d2e4cd4dfcd0eda3b206fa36d14d8ce59e"}
Sep 10 21:04:29.982253 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.982072    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"]
Sep 10 21:04:29.990037 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.990009    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"]
Sep 10 21:04:29.990295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:29.990233    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf" podUID="4b501a7f-54e1-4369-8d73-3074c90a4bef" containerName="manager" containerID="cri-o://7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17" gracePeriod=2
Sep 10 21:04:30.010550 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.010158    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4b501a7f-54e1-4369-8d73-3074c90a4bef\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\": pods \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:30.016069 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.016036    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"]
Sep 10 21:04:30.016729 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.016706    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" containerName="manager"
Sep 10 21:04:30.016729 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.016729    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" containerName="manager"
Sep 10 21:04:30.016924 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.016816    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" containerName="manager"
Sep 10 21:04:30.019461 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.019438    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"]
Sep 10 21:04:30.019575 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.019517    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.022184 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.022153    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-cg8zf\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="4b501a7f-54e1-4369-8d73-3074c90a4bef" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:30.026471 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.026378    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"]
Sep 10 21:04:30.026737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.026682    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" containerName="manager" containerID="cri-o://ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6" gracePeriod=2
Sep 10 21:04:30.028750 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.028688    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"]
Sep 10 21:04:30.029186 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.029165    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b501a7f-54e1-4369-8d73-3074c90a4bef" containerName="manager"
Sep 10 21:04:30.029186 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.029185    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b501a7f-54e1-4369-8d73-3074c90a4bef" containerName="manager"
Sep 10 21:04:30.029352 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.029336    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b501a7f-54e1-4369-8d73-3074c90a4bef" containerName="manager"
Sep 10 21:04:30.032063 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.032006    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.033929 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.033889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"]
Sep 10 21:04:30.044976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.044948    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"]
Sep 10 21:04:30.060051 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.060010    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"]
Sep 10 21:04:30.060364 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.060322    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.064915 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.064888    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"]
Sep 10 21:04:30.065372 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.065346    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" containerName="manager"
Sep 10 21:04:30.065372 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.065365    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" containerName="manager"
Sep 10 21:04:30.065548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.065502    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" containerName="manager"
Sep 10 21:04:30.067360 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.067334    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:30.086525 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.086488    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"]
Sep 10 21:04:30.111318 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.111279    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.136543 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.136504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb7hn\" (UniqueName: \"kubernetes.io/projected/55cb5039-fdce-4a16-a518-215f62842a79-kube-api-access-zb7hn\") pod \"limitador-operator-controller-manager-74495c69f8-66ghd\" (UID: \"55cb5039-fdce-4a16-a518-215f62842a79\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:30.136667 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.136558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtnhj\" (UniqueName: \"kubernetes.io/projected/ad16d846-a348-4383-aae6-e707ba0af3d0-kube-api-access-mtnhj\") pod \"kuadrant-operator-controller-manager-5f685c496f-vd6hp\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.136737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.136667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/e0fa1acb-7af9-45d3-bdc5-40d303647d42-kube-api-access-28mcv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7jdtk\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.136737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.136715    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fa1acb-7af9-45d3-bdc5-40d303647d42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7jdtk\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.136961 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.136768    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad16d846-a348-4383-aae6-e707ba0af3d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-vd6hp\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.237469 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.237430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/e0fa1acb-7af9-45d3-bdc5-40d303647d42-kube-api-access-28mcv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7jdtk\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.237622 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.237502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fa1acb-7af9-45d3-bdc5-40d303647d42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7jdtk\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.237622 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.237550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad16d846-a348-4383-aae6-e707ba0af3d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-vd6hp\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.237622 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.237613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb7hn\" (UniqueName: \"kubernetes.io/projected/55cb5039-fdce-4a16-a518-215f62842a79-kube-api-access-zb7hn\") pod \"limitador-operator-controller-manager-74495c69f8-66ghd\" (UID: \"55cb5039-fdce-4a16-a518-215f62842a79\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:30.237766 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.237643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnhj\" (UniqueName: \"kubernetes.io/projected/ad16d846-a348-4383-aae6-e707ba0af3d0-kube-api-access-mtnhj\") pod \"kuadrant-operator-controller-manager-5f685c496f-vd6hp\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.238027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.238000    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad16d846-a348-4383-aae6-e707ba0af3d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-vd6hp\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.238064 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.238007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fa1acb-7af9-45d3-bdc5-40d303647d42-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7jdtk\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.247307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.247269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtnhj\" (UniqueName: \"kubernetes.io/projected/ad16d846-a348-4383-aae6-e707ba0af3d0-kube-api-access-mtnhj\") pod \"kuadrant-operator-controller-manager-5f685c496f-vd6hp\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.248137 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.248108    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb7hn\" (UniqueName: \"kubernetes.io/projected/55cb5039-fdce-4a16-a518-215f62842a79-kube-api-access-zb7hn\") pod \"limitador-operator-controller-manager-74495c69f8-66ghd\" (UID: \"55cb5039-fdce-4a16-a518-215f62842a79\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:30.248548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.248525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/e0fa1acb-7af9-45d3-bdc5-40d303647d42-kube-api-access-28mcv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7jdtk\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.259563 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.259537    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:30.261908 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.261879    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.267137 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.267116    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.269202 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.269174    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.338600 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.338553    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbwlg\" (UniqueName: \"kubernetes.io/projected/4b501a7f-54e1-4369-8d73-3074c90a4bef-kube-api-access-tbwlg\") pod \"4b501a7f-54e1-4369-8d73-3074c90a4bef\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") "
Sep 10 21:04:30.339036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.338631    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b501a7f-54e1-4369-8d73-3074c90a4bef-extensions-socket-volume\") pod \"4b501a7f-54e1-4369-8d73-3074c90a4bef\" (UID: \"4b501a7f-54e1-4369-8d73-3074c90a4bef\") "
Sep 10 21:04:30.339036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.338711    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjmd7\" (UniqueName: \"kubernetes.io/projected/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75-kube-api-access-qjmd7\") pod \"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75\" (UID: \"1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75\") "
Sep 10 21:04:30.339165 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.339135    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b501a7f-54e1-4369-8d73-3074c90a4bef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4b501a7f-54e1-4369-8d73-3074c90a4bef" (UID: "4b501a7f-54e1-4369-8d73-3074c90a4bef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:30.340979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.340952    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75-kube-api-access-qjmd7" (OuterVolumeSpecName: "kube-api-access-qjmd7") pod "1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" (UID: "1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75"). InnerVolumeSpecName "kube-api-access-qjmd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:30.340979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.340968    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b501a7f-54e1-4369-8d73-3074c90a4bef-kube-api-access-tbwlg" (OuterVolumeSpecName: "kube-api-access-tbwlg") pod "4b501a7f-54e1-4369-8d73-3074c90a4bef" (UID: "4b501a7f-54e1-4369-8d73-3074c90a4bef"). InnerVolumeSpecName "kube-api-access-tbwlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:30.439855 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.439809    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b501a7f-54e1-4369-8d73-3074c90a4bef-extensions-socket-volume\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:30.439855 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.439844    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjmd7\" (UniqueName: \"kubernetes.io/projected/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75-kube-api-access-qjmd7\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:30.439855 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.439859    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbwlg\" (UniqueName: \"kubernetes.io/projected/4b501a7f-54e1-4369-8d73-3074c90a4bef-kube-api-access-tbwlg\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:30.441730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.441688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.451763 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.451668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.458613 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.458579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:30.737674 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.737650    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"]
Sep 10 21:04:30.740675 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:30.740641    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad16d846_a348_4383_aae6_e707ba0af3d0.slice/crio-50105bb154bdcb4af2be7d53460cfbafa13b604085499b62061833df8eb9aa43 WatchSource:0}: Error finding container 50105bb154bdcb4af2be7d53460cfbafa13b604085499b62061833df8eb9aa43: Status 404 returned error can't find the container with id 50105bb154bdcb4af2be7d53460cfbafa13b604085499b62061833df8eb9aa43
Sep 10 21:04:30.741389 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.741368    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"]
Sep 10 21:04:30.744054 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:30.744024    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fa1acb_7af9_45d3_bdc5_40d303647d42.slice/crio-57f5578ba19742c49c697d98505d8dc88813305444fa230d7b39e2559e46c50c WatchSource:0}: Error finding container 57f5578ba19742c49c697d98505d8dc88813305444fa230d7b39e2559e46c50c: Status 404 returned error can't find the container with id 57f5578ba19742c49c697d98505d8dc88813305444fa230d7b39e2559e46c50c
Sep 10 21:04:30.751252 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.751179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"]
Sep 10 21:04:30.753853 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:30.753831    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cb5039_fdce_4a16_a518_215f62842a79.slice/crio-587b7d460a8d1923a1bd08cfbde2f5c5c8afc83f348ea32fd2d791c302010456 WatchSource:0}: Error finding container 587b7d460a8d1923a1bd08cfbde2f5c5c8afc83f348ea32fd2d791c302010456: Status 404 returned error can't find the container with id 587b7d460a8d1923a1bd08cfbde2f5c5c8afc83f348ea32fd2d791c302010456
Sep 10 21:04:30.983753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.983715    2573 generic.go:356] "Generic (PLEG): container finished" podID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" containerID="ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6" exitCode=0
Sep 10 21:04:30.983936 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.983760    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.983936 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.983806    2573 scope.go:117] "RemoveContainer" containerID="ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6"
Sep 10 21:04:30.985532 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.985506    2573 generic.go:356] "Generic (PLEG): container finished" podID="4b501a7f-54e1-4369-8d73-3074c90a4bef" containerID="7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17" exitCode=0
Sep 10 21:04:30.985634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.985545    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-cg8zf"
Sep 10 21:04:30.986102 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.986043    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.987903 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.987837    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:30.988014 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.987994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp" event={"ID":"ad16d846-a348-4383-aae6-e707ba0af3d0","Type":"ContainerStarted","Data":"a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333"}
Sep 10 21:04:30.988069 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.988052    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:30.988130 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.988077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp" event={"ID":"ad16d846-a348-4383-aae6-e707ba0af3d0","Type":"ContainerStarted","Data":"50105bb154bdcb4af2be7d53460cfbafa13b604085499b62061833df8eb9aa43"}
Sep 10 21:04:30.994290 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.994251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk" event={"ID":"e0fa1acb-7af9-45d3-bdc5-40d303647d42","Type":"ContainerStarted","Data":"e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81"}
Sep 10 21:04:30.994658 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.994641    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:30.994785 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.994764    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk" event={"ID":"e0fa1acb-7af9-45d3-bdc5-40d303647d42","Type":"ContainerStarted","Data":"57f5578ba19742c49c697d98505d8dc88813305444fa230d7b39e2559e46c50c"}
Sep 10 21:04:30.996812 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.996713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd" event={"ID":"55cb5039-fdce-4a16-a518-215f62842a79","Type":"ContainerStarted","Data":"ea4a45dac6bf5d8d0ecd2b679724ee599436dca6ce7ca8183fc838e7b9d6e678"}
Sep 10 21:04:30.996812 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.996772    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd" event={"ID":"55cb5039-fdce-4a16-a518-215f62842a79","Type":"ContainerStarted","Data":"587b7d460a8d1923a1bd08cfbde2f5c5c8afc83f348ea32fd2d791c302010456"}
Sep 10 21:04:30.997019 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.996817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:30.997960 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.997935    2573 scope.go:117] "RemoveContainer" containerID="ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6"
Sep 10 21:04:30.998346 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:30.998324    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6\": container with ID starting with ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6 not found: ID does not exist" containerID="ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6"
Sep 10 21:04:30.998470 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.998355    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6"} err="failed to get container status \"ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6\": rpc error: code = NotFound desc = could not find container \"ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6\": container with ID starting with ed0e03a50375e0b2edee43ddcf27b42227a598f133d739103912a8c93fcfb7c6 not found: ID does not exist"
Sep 10 21:04:30.998470 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.998376    2573 scope.go:117] "RemoveContainer" containerID="7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17"
Sep 10 21:04:30.998937 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:30.998910    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" containerName="manager" containerID="cri-o://e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0" gracePeriod=2
Sep 10 21:04:31.009819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.009696    2573 scope.go:117] "RemoveContainer" containerID="7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17"
Sep 10 21:04:31.010167 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:31.010140    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17\": container with ID starting with 7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17 not found: ID does not exist" containerID="7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17"
Sep 10 21:04:31.010394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.010182    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17"} err="failed to get container status \"7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17\": rpc error: code = NotFound desc = could not find container \"7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17\": container with ID starting with 7f7afdd32ad8491da414f2028418978487c32846d4a5bf99693c7415e76c8f17 not found: ID does not exist"
Sep 10 21:04:31.011475 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:31.011442    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:31.013281 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:31.013252    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:31.036528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.036472    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp" podStartSLOduration=2.036456316 podStartE2EDuration="2.036456316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:31.009510963 +0000 UTC m=+393.443340916" watchObservedRunningTime="2026-09-10 21:04:31.036456316 +0000 UTC m=+393.470286265"
Sep 10 21:04:31.036711 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.036690    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk" podStartSLOduration=2.036684273 podStartE2EDuration="2.036684273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:31.03543185 +0000 UTC m=+393.469261800" watchObservedRunningTime="2026-09-10 21:04:31.036684273 +0000 UTC m=+393.470514221"
Sep 10 21:04:31.061624 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.061549    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd" podStartSLOduration=1.061527032 podStartE2EDuration="1.061527032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:31.060774803 +0000 UTC m=+393.494604753" watchObservedRunningTime="2026-09-10 21:04:31.061527032 +0000 UTC m=+393.495356982"
Sep 10 21:04:31.236245 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.236219    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:31.238365 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:31.238314    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:31.240267 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:31.240248    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:31.347455 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.347414    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac75063-f133-42bf-91a7-04297fe1b55c-extensions-socket-volume\") pod \"fac75063-f133-42bf-91a7-04297fe1b55c\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") "
Sep 10 21:04:31.347853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.347506    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr4km\" (UniqueName: \"kubernetes.io/projected/fac75063-f133-42bf-91a7-04297fe1b55c-kube-api-access-vr4km\") pod \"fac75063-f133-42bf-91a7-04297fe1b55c\" (UID: \"fac75063-f133-42bf-91a7-04297fe1b55c\") "
Sep 10 21:04:31.347853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.347700    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac75063-f133-42bf-91a7-04297fe1b55c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fac75063-f133-42bf-91a7-04297fe1b55c" (UID: "fac75063-f133-42bf-91a7-04297fe1b55c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:31.347853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.347827    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac75063-f133-42bf-91a7-04297fe1b55c-extensions-socket-volume\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:31.349634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.349610    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac75063-f133-42bf-91a7-04297fe1b55c-kube-api-access-vr4km" (OuterVolumeSpecName: "kube-api-access-vr4km") pod "fac75063-f133-42bf-91a7-04297fe1b55c" (UID: "fac75063-f133-42bf-91a7-04297fe1b55c"). InnerVolumeSpecName "kube-api-access-vr4km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:31.449138 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:31.449097    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr4km\" (UniqueName: \"kubernetes.io/projected/fac75063-f133-42bf-91a7-04297fe1b55c-kube-api-access-vr4km\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:32.007762 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.007721    2573 generic.go:356] "Generic (PLEG): container finished" podID="fac75063-f133-42bf-91a7-04297fe1b55c" containerID="e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0" exitCode=2
Sep 10 21:04:32.007948 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.007790    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:32.007948 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.007835    2573 scope.go:117] "RemoveContainer" containerID="e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0"
Sep 10 21:04:32.010035 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:32.010004    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:32.011895 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:32.011862    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:32.018592 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.018574    2573 scope.go:117] "RemoveContainer" containerID="e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0"
Sep 10 21:04:32.018912 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:32.018895    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0\": container with ID starting with e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0 not found: ID does not exist" containerID="e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0"
Sep 10 21:04:32.018951 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.018923    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0"} err="failed to get container status \"e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0\": rpc error: code = NotFound desc = could not find container \"e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0\": container with ID starting with e50950733811b228048e83bb597de9eed39295c5db8bd55872d08b8c7d8a15e0 not found: ID does not exist"
Sep 10 21:04:32.019569 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:32.019546    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-9d4tn\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9d4tn"
Sep 10 21:04:32.021332 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:32.021313    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5tqwg\" is forbidden: User \"system:node:ip-10-0-135-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-116.ec2.internal' and this object" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5tqwg"
Sep 10 21:04:32.042432 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.042386    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75" path="/var/lib/kubelet/pods/1dbd16ef-1ac9-4ade-8064-64ec4e0dcb75/volumes"
Sep 10 21:04:32.042784 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.042770    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b501a7f-54e1-4369-8d73-3074c90a4bef" path="/var/lib/kubelet/pods/4b501a7f-54e1-4369-8d73-3074c90a4bef/volumes"
Sep 10 21:04:32.043077 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.043065    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac75063-f133-42bf-91a7-04297fe1b55c" path="/var/lib/kubelet/pods/fac75063-f133-42bf-91a7-04297fe1b55c/volumes"
Sep 10 21:04:32.360526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.360495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:32.458007 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:32.457965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:34.964863 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:34.964815    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:35.062207 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:35.062156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:36.129525 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:36.129490    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:36.188775 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:36.188734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:38.137686 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:38.137652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:38.239710 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:38.239664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:42.013179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.013150    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:42.013576 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.013246    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-66ghd"
Sep 10 21:04:42.080902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.080870    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"]
Sep 10 21:04:42.081110 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.081075    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk" podUID="e0fa1acb-7af9-45d3-bdc5-40d303647d42" containerName="manager" containerID="cri-o://e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81" gracePeriod=10
Sep 10 21:04:42.082824 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.082803    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:42.331316 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.331281    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"]
Sep 10 21:04:42.335237 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.335215    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.341094 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.341077    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:42.350595 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.350570    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"]
Sep 10 21:04:42.448359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.448327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fa1acb-7af9-45d3-bdc5-40d303647d42-extensions-socket-volume\") pod \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") "
Sep 10 21:04:42.448556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.448408    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/e0fa1acb-7af9-45d3-bdc5-40d303647d42-kube-api-access-28mcv\") pod \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\" (UID: \"e0fa1acb-7af9-45d3-bdc5-40d303647d42\") "
Sep 10 21:04:42.448556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.448543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-f7sf8\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.448700 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.448606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrrh\" (UniqueName: \"kubernetes.io/projected/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-kube-api-access-lzrrh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-f7sf8\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.448754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.448731    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0fa1acb-7af9-45d3-bdc5-40d303647d42-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e0fa1acb-7af9-45d3-bdc5-40d303647d42" (UID: "e0fa1acb-7af9-45d3-bdc5-40d303647d42"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:42.450513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.450487    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0fa1acb-7af9-45d3-bdc5-40d303647d42-kube-api-access-28mcv" (OuterVolumeSpecName: "kube-api-access-28mcv") pod "e0fa1acb-7af9-45d3-bdc5-40d303647d42" (UID: "e0fa1acb-7af9-45d3-bdc5-40d303647d42"). InnerVolumeSpecName "kube-api-access-28mcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:42.549818 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.549777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-f7sf8\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.550022 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.549842    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrrh\" (UniqueName: \"kubernetes.io/projected/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-kube-api-access-lzrrh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-f7sf8\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.550022 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.549872    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fa1acb-7af9-45d3-bdc5-40d303647d42-extensions-socket-volume\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:42.550022 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.549884    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28mcv\" (UniqueName: \"kubernetes.io/projected/e0fa1acb-7af9-45d3-bdc5-40d303647d42-kube-api-access-28mcv\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:42.550260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.550236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-f7sf8\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.552415 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.552363    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:42.558489 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.558439    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrrh\" (UniqueName: \"kubernetes.io/projected/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-kube-api-access-lzrrh\") pod \"kuadrant-operator-controller-manager-5769f99d9f-f7sf8\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.647741 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.647697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:42.649936 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.649748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:42.839103 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.839061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:42.925149 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.925113    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"]
Sep 10 21:04:42.927445 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:42.927421    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:42.928126 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:42.928104    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc5066d_535d_4bdd_ad90_c9f3549cd57e.slice/crio-03980de99fbaee3725d8e99941366e81f3797e32b27efc9a381a6bb57ecc1536 WatchSource:0}: Error finding container 03980de99fbaee3725d8e99941366e81f3797e32b27efc9a381a6bb57ecc1536: Status 404 returned error can't find the container with id 03980de99fbaee3725d8e99941366e81f3797e32b27efc9a381a6bb57ecc1536
Sep 10 21:04:43.068664 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.068628    2573 generic.go:356] "Generic (PLEG): container finished" podID="e0fa1acb-7af9-45d3-bdc5-40d303647d42" containerID="e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81" exitCode=0
Sep 10 21:04:43.069058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.068678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"
Sep 10 21:04:43.069058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.068713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk" event={"ID":"e0fa1acb-7af9-45d3-bdc5-40d303647d42","Type":"ContainerDied","Data":"e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81"}
Sep 10 21:04:43.069058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.068768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk" event={"ID":"e0fa1acb-7af9-45d3-bdc5-40d303647d42","Type":"ContainerDied","Data":"57f5578ba19742c49c697d98505d8dc88813305444fa230d7b39e2559e46c50c"}
Sep 10 21:04:43.069058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.068804    2573 scope.go:117] "RemoveContainer" containerID="e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81"
Sep 10 21:04:43.070610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.070582    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8" event={"ID":"0bc5066d-535d-4bdd-ad90-c9f3549cd57e","Type":"ContainerStarted","Data":"affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714"}
Sep 10 21:04:43.070737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.070627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8" event={"ID":"0bc5066d-535d-4bdd-ad90-c9f3549cd57e","Type":"ContainerStarted","Data":"03980de99fbaee3725d8e99941366e81f3797e32b27efc9a381a6bb57ecc1536"}
Sep 10 21:04:43.070737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.070682    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:43.077752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.077736    2573 scope.go:117] "RemoveContainer" containerID="e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81"
Sep 10 21:04:43.078015 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:43.077998    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81\": container with ID starting with e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81 not found: ID does not exist" containerID="e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81"
Sep 10 21:04:43.078062 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.078020    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81"} err="failed to get container status \"e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81\": rpc error: code = NotFound desc = could not find container \"e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81\": container with ID starting with e7d14ccf98a562aa6834e7cba8e157252443483ff05eb726839f9ca06719da81 not found: ID does not exist"
Sep 10 21:04:43.093970 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.093882    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8" podStartSLOduration=1.093865115 podStartE2EDuration="1.093865115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:43.092584076 +0000 UTC m=+405.526414039" watchObservedRunningTime="2026-09-10 21:04:43.093865115 +0000 UTC m=+405.527695065"
Sep 10 21:04:43.111698 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.111674    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"]
Sep 10 21:04:43.114996 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.114974    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7jdtk"]
Sep 10 21:04:43.742224 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.742178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:43.843119 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:43.843086    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:44.042949 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:44.042869    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0fa1acb-7af9-45d3-bdc5-40d303647d42" path="/var/lib/kubelet/pods/e0fa1acb-7af9-45d3-bdc5-40d303647d42/volumes"
Sep 10 21:04:47.438644 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:47.438606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.499541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:47.499506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:47.552303 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:47.552270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:51.354955 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:51.354916    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:51.457004 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:51.456969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:54.079648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.079617    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:04:54.134728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.134689    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"]
Sep 10 21:04:54.135032 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.135005    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp" podUID="ad16d846-a348-4383-aae6-e707ba0af3d0" containerName="manager" containerID="cri-o://a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333" gracePeriod=10
Sep 10 21:04:54.394233 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.394208    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:54.462561 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.462527    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtnhj\" (UniqueName: \"kubernetes.io/projected/ad16d846-a348-4383-aae6-e707ba0af3d0-kube-api-access-mtnhj\") pod \"ad16d846-a348-4383-aae6-e707ba0af3d0\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") "
Sep 10 21:04:54.462765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.462588    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad16d846-a348-4383-aae6-e707ba0af3d0-extensions-socket-volume\") pod \"ad16d846-a348-4383-aae6-e707ba0af3d0\" (UID: \"ad16d846-a348-4383-aae6-e707ba0af3d0\") "
Sep 10 21:04:54.462991 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.462964    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad16d846-a348-4383-aae6-e707ba0af3d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ad16d846-a348-4383-aae6-e707ba0af3d0" (UID: "ad16d846-a348-4383-aae6-e707ba0af3d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:54.464750 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.464723    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad16d846-a348-4383-aae6-e707ba0af3d0-kube-api-access-mtnhj" (OuterVolumeSpecName: "kube-api-access-mtnhj") pod "ad16d846-a348-4383-aae6-e707ba0af3d0" (UID: "ad16d846-a348-4383-aae6-e707ba0af3d0"). InnerVolumeSpecName "kube-api-access-mtnhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:54.563200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.563162    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtnhj\" (UniqueName: \"kubernetes.io/projected/ad16d846-a348-4383-aae6-e707ba0af3d0-kube-api-access-mtnhj\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:54.563200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:54.563194    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad16d846-a348-4383-aae6-e707ba0af3d0-extensions-socket-volume\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:04:55.146131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.146097    2573 generic.go:356] "Generic (PLEG): container finished" podID="ad16d846-a348-4383-aae6-e707ba0af3d0" containerID="a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333" exitCode=0
Sep 10 21:04:55.146625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.146141    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"
Sep 10 21:04:55.146625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.146176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp" event={"ID":"ad16d846-a348-4383-aae6-e707ba0af3d0","Type":"ContainerDied","Data":"a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333"}
Sep 10 21:04:55.146625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.146232    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp" event={"ID":"ad16d846-a348-4383-aae6-e707ba0af3d0","Type":"ContainerDied","Data":"50105bb154bdcb4af2be7d53460cfbafa13b604085499b62061833df8eb9aa43"}
Sep 10 21:04:55.146625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.146254    2573 scope.go:117] "RemoveContainer" containerID="a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333"
Sep 10 21:04:55.155734 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.155717    2573 scope.go:117] "RemoveContainer" containerID="a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333"
Sep 10 21:04:55.156063 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:04:55.156043    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333\": container with ID starting with a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333 not found: ID does not exist" containerID="a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333"
Sep 10 21:04:55.156126 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.156072    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333"} err="failed to get container status \"a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333\": rpc error: code = NotFound desc = could not find container \"a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333\": container with ID starting with a5718098a1032ec275b9ce0d3eb1bbbf9a3b966a92cf8f329b4da4cbe0a77333 not found: ID does not exist"
Sep 10 21:04:55.177006 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.176967    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"]
Sep 10 21:04:55.181618 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:55.181587    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-vd6hp"]
Sep 10 21:04:56.043759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:56.043727    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad16d846-a348-4383-aae6-e707ba0af3d0" path="/var/lib/kubelet/pods/ad16d846-a348-4383-aae6-e707ba0af3d0/volumes"
Sep 10 21:04:58.367354 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.367320    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"]
Sep 10 21:04:58.367881 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.367863    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fa1acb-7af9-45d3-bdc5-40d303647d42" containerName="manager"
Sep 10 21:04:58.367959 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.367884    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fa1acb-7af9-45d3-bdc5-40d303647d42" containerName="manager"
Sep 10 21:04:58.367959 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.367903    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad16d846-a348-4383-aae6-e707ba0af3d0" containerName="manager"
Sep 10 21:04:58.367959 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.367912    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad16d846-a348-4383-aae6-e707ba0af3d0" containerName="manager"
Sep 10 21:04:58.368125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.367999    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad16d846-a348-4383-aae6-e707ba0af3d0" containerName="manager"
Sep 10 21:04:58.368125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.368016    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0fa1acb-7af9-45d3-bdc5-40d303647d42" containerName="manager"
Sep 10 21:04:58.370910 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.370889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.373240 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.373219    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:04:58.373447 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.373266    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mr7sg\""
Sep 10 21:04:58.381189 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.381162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"]
Sep 10 21:04:58.391887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.391844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:58.394104 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394076    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394300 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394272    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2233ce-a61b-403a-912e-3eee8c4e8184-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394338 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394306    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394380 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394449 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394432    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394487 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf9rm\" (UniqueName: \"kubernetes.io/projected/2a2233ce-a61b-403a-912e-3eee8c4e8184-kube-api-access-pf9rm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.394520 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.394510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495370 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495370 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2233ce-a61b-403a-912e-3eee8c4e8184-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf9rm\" (UniqueName: \"kubernetes.io/projected/2a2233ce-a61b-403a-912e-3eee8c4e8184-kube-api-access-pf9rm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.495631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495614    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.496321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.496321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.495894    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.496321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.496017    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.496321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.496189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.496321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.496210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.496541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.496325    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2233ce-a61b-403a-912e-3eee8c4e8184-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.497993 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.497970    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.498170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.498156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.506491 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.506469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2233ce-a61b-403a-912e-3eee8c4e8184-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.507258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.507233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf9rm\" (UniqueName: \"kubernetes.io/projected/2a2233ce-a61b-403a-912e-3eee8c4e8184-kube-api-access-pf9rm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jbrvm\" (UID: \"2a2233ce-a61b-403a-912e-3eee8c4e8184\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.519174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.519101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:04:58.682291 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.682191    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:04:58.952812 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:58.952743    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"]
Sep 10 21:04:58.955048 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:04:58.955020    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2233ce_a61b_403a_912e_3eee8c4e8184.slice/crio-29f45725f8fb75aefc9bfde2c78d0c719b70ad743ee043b371dbe1731b820aba WatchSource:0}: Error finding container 29f45725f8fb75aefc9bfde2c78d0c719b70ad743ee043b371dbe1731b820aba: Status 404 returned error can't find the container with id 29f45725f8fb75aefc9bfde2c78d0c719b70ad743ee043b371dbe1731b820aba
Sep 10 21:04:59.169898 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:04:59.169865    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" event={"ID":"2a2233ce-a61b-403a-912e-3eee8c4e8184","Type":"ContainerStarted","Data":"29f45725f8fb75aefc9bfde2c78d0c719b70ad743ee043b371dbe1731b820aba"}
Sep 10 21:05:01.380206 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:01.380170    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:05:01.380518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:01.380244    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:05:01.380518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:01.380283    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:05:02.188204 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:02.188156    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" event={"ID":"2a2233ce-a61b-403a-912e-3eee8c4e8184","Type":"ContainerStarted","Data":"ffb99f5cea2e77fb4c2af7aef6bfeae9416f4f45543e4de26e64d56f39f70ad6"}
Sep 10 21:05:02.208021 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:02.207958    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podStartSLOduration=1.7853104869999998 podStartE2EDuration="4.207942774s" totalImagesPullingTime="2.422632287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:02.207341812 +0000 UTC m=+424.641171762" watchObservedRunningTime="2026-09-10 21:05:02.207942774 +0000 UTC m=+424.641772723"
Sep 10 21:05:02.682444 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:02.682382    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:05:02.687266 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:02.687241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:05:03.192661 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:03.192630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:05:03.193573 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:03.193553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:05:13.355171 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.355106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:13.355902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.355880    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:13.358285 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.358269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.360730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.360705    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-45qt5\""
Sep 10 21:05:13.360836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.360705    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 21:05:13.368482 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.368445    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:13.429867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.429835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-config-file\") pod \"limitador-limitador-8588749977-4dlqn\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") " pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.430036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.429982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4f25\" (UniqueName: \"kubernetes.io/projected/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-kube-api-access-z4f25\") pod \"limitador-limitador-8588749977-4dlqn\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") " pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.450782 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.450747    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:13.452843 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.452818    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:13.531373 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.531332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-config-file\") pod \"limitador-limitador-8588749977-4dlqn\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") " pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.531567 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.531473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4f25\" (UniqueName: \"kubernetes.io/projected/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-kube-api-access-z4f25\") pod \"limitador-limitador-8588749977-4dlqn\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") " pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.531985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.531964    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-config-file\") pod \"limitador-limitador-8588749977-4dlqn\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") " pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.539004 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.538977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4f25\" (UniqueName: \"kubernetes.io/projected/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-kube-api-access-z4f25\") pod \"limitador-limitador-8588749977-4dlqn\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") " pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.552762 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.552726    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:13.670466 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.670351    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:13.941113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:13.941087    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:13.942991 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:05:13.942967    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1328cbc2_ea60_4f26_8cb9_6c52bb7fc50e.slice/crio-9308a375699f535192f5d335e5e7983e9aefea6479221c4c3bd7df1f14130926 WatchSource:0}: Error finding container 9308a375699f535192f5d335e5e7983e9aefea6479221c4c3bd7df1f14130926: Status 404 returned error can't find the container with id 9308a375699f535192f5d335e5e7983e9aefea6479221c4c3bd7df1f14130926
Sep 10 21:05:14.175809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:14.175761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:14.244289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:14.244185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn" event={"ID":"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e","Type":"ContainerStarted","Data":"9308a375699f535192f5d335e5e7983e9aefea6479221c4c3bd7df1f14130926"}
Sep 10 21:05:14.263764 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:14.263727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:19.272000 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:19.271968    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn" event={"ID":"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e","Type":"ContainerStarted","Data":"4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b"}
Sep 10 21:05:19.272394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:19.272111    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:19.288958 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:19.288905    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn" podStartSLOduration=1.071246332 podStartE2EDuration="6.288887425s" totalImagesPullingTime="5.217641093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:19.287387402 +0000 UTC m=+441.721217367" watchObservedRunningTime="2026-09-10 21:05:19.288887425 +0000 UTC m=+441.722717424"
Sep 10 21:05:28.308149 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:28.308114    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:28.309064 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:28.308321    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn" podUID="1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" containerName="limitador" containerID="cri-o://4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b" gracePeriod=30
Sep 10 21:05:28.311051 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:28.311025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:29.252667 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.252639    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:29.322641 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.322602    2573 generic.go:356] "Generic (PLEG): container finished" podID="1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" containerID="4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b" exitCode=0
Sep 10 21:05:29.323057 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.322653    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn"
Sep 10 21:05:29.323057 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.322690    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn" event={"ID":"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e","Type":"ContainerDied","Data":"4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b"}
Sep 10 21:05:29.323057 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.322748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4dlqn" event={"ID":"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e","Type":"ContainerDied","Data":"9308a375699f535192f5d335e5e7983e9aefea6479221c4c3bd7df1f14130926"}
Sep 10 21:05:29.323057 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.322772    2573 scope.go:117] "RemoveContainer" containerID="4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b"
Sep 10 21:05:29.331387 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.331369    2573 scope.go:117] "RemoveContainer" containerID="4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b"
Sep 10 21:05:29.331741 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:05:29.331721    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b\": container with ID starting with 4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b not found: ID does not exist" containerID="4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b"
Sep 10 21:05:29.331809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.331751    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b"} err="failed to get container status \"4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b\": rpc error: code = NotFound desc = could not find container \"4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b\": container with ID starting with 4ebd88f8de37f6b8261b9f0579e8a3e27db4df8ec6a5515e826c5bd250b8542b not found: ID does not exist"
Sep 10 21:05:29.382372 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.382289    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-config-file\") pod \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") "
Sep 10 21:05:29.382372 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.382340    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4f25\" (UniqueName: \"kubernetes.io/projected/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-kube-api-access-z4f25\") pod \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\" (UID: \"1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e\") "
Sep 10 21:05:29.382690 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.382667    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-config-file" (OuterVolumeSpecName: "config-file") pod "1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" (UID: "1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:05:29.384423 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.384385    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-kube-api-access-z4f25" (OuterVolumeSpecName: "kube-api-access-z4f25") pod "1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" (UID: "1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e"). InnerVolumeSpecName "kube-api-access-z4f25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:29.483521 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.483476    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-config-file\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:05:29.483521 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.483517    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4f25\" (UniqueName: \"kubernetes.io/projected/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e-kube-api-access-z4f25\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:05:29.485065 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.485033    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:29.580866 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.580827    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:29.643296 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.643204    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:29.647321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.647287    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4dlqn"]
Sep 10 21:05:29.900778 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.900674    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"]
Sep 10 21:05:29.901064 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.901049    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" containerName="limitador"
Sep 10 21:05:29.901064 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.901063    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" containerName="limitador"
Sep 10 21:05:29.901203 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.901146    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" containerName="limitador"
Sep 10 21:05:29.905858 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.905834    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:29.908322 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.908292    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 21:05:29.908322 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.908292    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:05:29.908584 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.908330    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dtqvv\""
Sep 10 21:05:29.908584 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.908324    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:05:29.913765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.913736    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"]
Sep 10 21:05:29.933241 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.933207    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:29.987102 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.987067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4v5\" (UniqueName: \"kubernetes.io/projected/973c7228-3a7b-4702-8222-07ea7ac53da6-kube-api-access-sk4v5\") pod \"postgres-69fb4594cf-sz8hg\" (UID: \"973c7228-3a7b-4702-8222-07ea7ac53da6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:29.987282 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:29.987124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/973c7228-3a7b-4702-8222-07ea7ac53da6-data\") pod \"postgres-69fb4594cf-sz8hg\" (UID: \"973c7228-3a7b-4702-8222-07ea7ac53da6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:30.042867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.042831    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e" path="/var/lib/kubelet/pods/1328cbc2-ea60-4f26-8cb9-6c52bb7fc50e/volumes"
Sep 10 21:05:30.088289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.088252    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4v5\" (UniqueName: \"kubernetes.io/projected/973c7228-3a7b-4702-8222-07ea7ac53da6-kube-api-access-sk4v5\") pod \"postgres-69fb4594cf-sz8hg\" (UID: \"973c7228-3a7b-4702-8222-07ea7ac53da6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:30.088289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.088303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/973c7228-3a7b-4702-8222-07ea7ac53da6-data\") pod \"postgres-69fb4594cf-sz8hg\" (UID: \"973c7228-3a7b-4702-8222-07ea7ac53da6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:30.088693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.088676    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/973c7228-3a7b-4702-8222-07ea7ac53da6-data\") pod \"postgres-69fb4594cf-sz8hg\" (UID: \"973c7228-3a7b-4702-8222-07ea7ac53da6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:30.096200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.096174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4v5\" (UniqueName: \"kubernetes.io/projected/973c7228-3a7b-4702-8222-07ea7ac53da6-kube-api-access-sk4v5\") pod \"postgres-69fb4594cf-sz8hg\" (UID: \"973c7228-3a7b-4702-8222-07ea7ac53da6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:30.218174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.218078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:30.488280 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:30.488190    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"]
Sep 10 21:05:30.491467 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:05:30.491393    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973c7228_3a7b_4702_8222_07ea7ac53da6.slice/crio-6202fcd5c06bbff0227e42ad7d2163d4d6656008d4d068923e21dcc58ff773b0 WatchSource:0}: Error finding container 6202fcd5c06bbff0227e42ad7d2163d4d6656008d4d068923e21dcc58ff773b0: Status 404 returned error can't find the container with id 6202fcd5c06bbff0227e42ad7d2163d4d6656008d4d068923e21dcc58ff773b0
Sep 10 21:05:31.337563 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:31.337523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg" event={"ID":"973c7228-3a7b-4702-8222-07ea7ac53da6","Type":"ContainerStarted","Data":"6202fcd5c06bbff0227e42ad7d2163d4d6656008d4d068923e21dcc58ff773b0"}
Sep 10 21:05:35.362344 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:35.362305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg" event={"ID":"973c7228-3a7b-4702-8222-07ea7ac53da6","Type":"ContainerStarted","Data":"3bbcb62ff627f3c5e47cd49cc4f0a3dbdf0b346552989fe3d18d0575057375a8"}
Sep 10 21:05:35.362791 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:35.362409    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:35.377104 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:35.377052    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg" podStartSLOduration=1.6475555929999999 podStartE2EDuration="6.377035537s" totalImagesPullingTime="4.729479944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:35.375903469 +0000 UTC m=+457.809733429" watchObservedRunningTime="2026-09-10 21:05:35.377035537 +0000 UTC m=+457.810865499"
Sep 10 21:05:41.396466 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:41.396436    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sz8hg"
Sep 10 21:05:41.713466 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:41.713376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:41.868068 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:41.868032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:49.133525 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.133494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:49.187231 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.187201    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7564cb5595-96c67"]
Sep 10 21:05:49.204886 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.204859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:49.216158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.216119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7564cb5595-96c67"]
Sep 10 21:05:49.216307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.216229    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.219058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.218986    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq4km\""
Sep 10 21:05:49.219058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.219017    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:05:49.219058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.219019    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:05:49.219318 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.219118    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:05:49.260172 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.260143    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:49.261215 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.261194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxk2v\" (UniqueName: \"kubernetes.io/projected/a10e16f4-6300-4e16-8f9a-74c6617274ef-kube-api-access-qxk2v\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.261286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.261258    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-webhook-cert\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.261325 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.261287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.327648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.327614    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:49.339012 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.338976    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-sfpdz"]
Sep 10 21:05:49.344491 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.344460    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.349792 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.349756    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-sfpdz"]
Sep 10 21:05:49.362096 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.362055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-webhook-cert\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.362267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.362103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-webhook-cert\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.362267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.362134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.362267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.362208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxk2v\" (UniqueName: \"kubernetes.io/projected/a10e16f4-6300-4e16-8f9a-74c6617274ef-kube-api-access-qxk2v\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.362267 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:05:49.362259    2573 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 10 21:05:49.362499 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.362270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-metrics-certs\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.362499 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:05:49.362337    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs podName:a10e16f4-6300-4e16-8f9a-74c6617274ef nodeName:}" failed. No retries permitted until 2026-09-10 21:05:49.862314783 +0000 UTC m=+472.296144710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs") pod "maas-controller-7564cb5595-96c67" (UID: "a10e16f4-6300-4e16-8f9a-74c6617274ef") : secret "maas-controller-metrics-tls" not found
Sep 10 21:05:49.362499 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.362378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcdmp\" (UniqueName: \"kubernetes.io/projected/2d370068-ee55-4386-9488-332442c5b706-kube-api-access-gcdmp\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.365439 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.365385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-webhook-cert\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.375327 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.375291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxk2v\" (UniqueName: \"kubernetes.io/projected/a10e16f4-6300-4e16-8f9a-74c6617274ef-kube-api-access-qxk2v\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.411556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.411471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:49.463660 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.463618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-metrics-certs\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.463660 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.463659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcdmp\" (UniqueName: \"kubernetes.io/projected/2d370068-ee55-4386-9488-332442c5b706-kube-api-access-gcdmp\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.463986 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.463804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-webhook-cert\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.466182 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.466148    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-webhook-cert\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.466322 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.466297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-metrics-certs\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.473210 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.473184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcdmp\" (UniqueName: \"kubernetes.io/projected/2d370068-ee55-4386-9488-332442c5b706-kube-api-access-gcdmp\") pod \"maas-controller-6f8fccc7c5-sfpdz\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") " pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.656055 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.656018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:49.868275 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.868236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.870786 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.870756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs\") pod \"maas-controller-7564cb5595-96c67\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") " pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:49.926911 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:49.926886    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-sfpdz"]
Sep 10 21:05:49.929318 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:05:49.929285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d370068_ee55_4386_9488_332442c5b706.slice/crio-e2e9393c4d4f98c0f9bbcf92d932e1cef9626fee782fb5d1b146a1b0c4f44368 WatchSource:0}: Error finding container e2e9393c4d4f98c0f9bbcf92d932e1cef9626fee782fb5d1b146a1b0c4f44368: Status 404 returned error can't find the container with id e2e9393c4d4f98c0f9bbcf92d932e1cef9626fee782fb5d1b146a1b0c4f44368
Sep 10 21:05:50.127960 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:50.127925    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:50.403053 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:50.403024    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7564cb5595-96c67"]
Sep 10 21:05:50.405307 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:05:50.405273    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10e16f4_6300_4e16_8f9a_74c6617274ef.slice/crio-597792ec818ccc506e98e46bf5b382957bee357ad8dd51fd1a2163f2d7634884 WatchSource:0}: Error finding container 597792ec818ccc506e98e46bf5b382957bee357ad8dd51fd1a2163f2d7634884: Status 404 returned error can't find the container with id 597792ec818ccc506e98e46bf5b382957bee357ad8dd51fd1a2163f2d7634884
Sep 10 21:05:50.439161 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:50.439065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7564cb5595-96c67" event={"ID":"a10e16f4-6300-4e16-8f9a-74c6617274ef","Type":"ContainerStarted","Data":"597792ec818ccc506e98e46bf5b382957bee357ad8dd51fd1a2163f2d7634884"}
Sep 10 21:05:50.440266 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:50.440241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz" event={"ID":"2d370068-ee55-4386-9488-332442c5b706","Type":"ContainerStarted","Data":"e2e9393c4d4f98c0f9bbcf92d932e1cef9626fee782fb5d1b146a1b0c4f44368"}
Sep 10 21:05:52.785006 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:52.784963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:52.885856 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:52.885765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:05:53.458829 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:53.458787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7564cb5595-96c67" event={"ID":"a10e16f4-6300-4e16-8f9a-74c6617274ef","Type":"ContainerStarted","Data":"7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0"}
Sep 10 21:05:53.459033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:53.458947    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:05:53.460507 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:53.460478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz" event={"ID":"2d370068-ee55-4386-9488-332442c5b706","Type":"ContainerStarted","Data":"9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048"}
Sep 10 21:05:53.460638 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:53.460610    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:05:53.480335 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:53.480289    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7564cb5595-96c67" podStartSLOduration=2.281754994 podStartE2EDuration="4.480272243s" totalImagesPullingTime="2.198517249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:53.479264494 +0000 UTC m=+475.913094453" watchObservedRunningTime="2026-09-10 21:05:53.480272243 +0000 UTC m=+475.914102192"
Sep 10 21:05:53.495713 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:05:53.495663    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz" podStartSLOduration=1.832124632 podStartE2EDuration="4.495647475s" totalImagesPullingTime="2.663522843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:53.49434081 +0000 UTC m=+475.928170762" watchObservedRunningTime="2026-09-10 21:05:53.495647475 +0000 UTC m=+475.929477422"
Sep 10 21:06:04.468113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.468077    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:06:04.468615 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.468155    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:06:04.536058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.536016    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7564cb5595-96c67"]
Sep 10 21:06:04.536316 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.536285    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7564cb5595-96c67" podUID="a10e16f4-6300-4e16-8f9a-74c6617274ef" containerName="manager" containerID="cri-o://7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0" gracePeriod=30
Sep 10 21:06:04.783981 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.783949    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:06:04.911844 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.911810    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxk2v\" (UniqueName: \"kubernetes.io/projected/a10e16f4-6300-4e16-8f9a-74c6617274ef-kube-api-access-qxk2v\") pod \"a10e16f4-6300-4e16-8f9a-74c6617274ef\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") "
Sep 10 21:06:04.912034 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.911917    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs\") pod \"a10e16f4-6300-4e16-8f9a-74c6617274ef\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") "
Sep 10 21:06:04.912034 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.911966    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-webhook-cert\") pod \"a10e16f4-6300-4e16-8f9a-74c6617274ef\" (UID: \"a10e16f4-6300-4e16-8f9a-74c6617274ef\") "
Sep 10 21:06:04.914292 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.914256    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a10e16f4-6300-4e16-8f9a-74c6617274ef" (UID: "a10e16f4-6300-4e16-8f9a-74c6617274ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:06:04.914448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.914255    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10e16f4-6300-4e16-8f9a-74c6617274ef-kube-api-access-qxk2v" (OuterVolumeSpecName: "kube-api-access-qxk2v") pod "a10e16f4-6300-4e16-8f9a-74c6617274ef" (UID: "a10e16f4-6300-4e16-8f9a-74c6617274ef"). InnerVolumeSpecName "kube-api-access-qxk2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:06:04.914448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:04.914265    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a10e16f4-6300-4e16-8f9a-74c6617274ef" (UID: "a10e16f4-6300-4e16-8f9a-74c6617274ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:06:05.013328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.013233    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxk2v\" (UniqueName: \"kubernetes.io/projected/a10e16f4-6300-4e16-8f9a-74c6617274ef-kube-api-access-qxk2v\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:06:05.013328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.013266    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:06:05.013328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.013276    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a10e16f4-6300-4e16-8f9a-74c6617274ef-webhook-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:06:05.521717 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.521677    2573 generic.go:356] "Generic (PLEG): container finished" podID="a10e16f4-6300-4e16-8f9a-74c6617274ef" containerID="7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0" exitCode=0
Sep 10 21:06:05.522140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.521726    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7564cb5595-96c67"
Sep 10 21:06:05.522140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.521768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7564cb5595-96c67" event={"ID":"a10e16f4-6300-4e16-8f9a-74c6617274ef","Type":"ContainerDied","Data":"7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0"}
Sep 10 21:06:05.522140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.521822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7564cb5595-96c67" event={"ID":"a10e16f4-6300-4e16-8f9a-74c6617274ef","Type":"ContainerDied","Data":"597792ec818ccc506e98e46bf5b382957bee357ad8dd51fd1a2163f2d7634884"}
Sep 10 21:06:05.522140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.521846    2573 scope.go:117] "RemoveContainer" containerID="7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0"
Sep 10 21:06:05.531048 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.531028    2573 scope.go:117] "RemoveContainer" containerID="7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0"
Sep 10 21:06:05.531409 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:06:05.531368    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0\": container with ID starting with 7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0 not found: ID does not exist" containerID="7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0"
Sep 10 21:06:05.531523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.531501    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0"} err="failed to get container status \"7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0\": rpc error: code = NotFound desc = could not find container \"7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0\": container with ID starting with 7823c35eca4069aa406f1bd8f6168ba5044aefb9230ec5583c0e4c6266514dd0 not found: ID does not exist"
Sep 10 21:06:05.542726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.542693    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7564cb5595-96c67"]
Sep 10 21:06:05.547071 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:05.547045    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7564cb5595-96c67"]
Sep 10 21:06:06.042870 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:06.042835    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a10e16f4-6300-4e16-8f9a-74c6617274ef" path="/var/lib/kubelet/pods/a10e16f4-6300-4e16-8f9a-74c6617274ef/volumes"
Sep 10 21:06:23.098093 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:23.098057    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:23.196973 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:23.196939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:24.654354 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.654314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:24.723151 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.723116    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"]
Sep 10 21:06:24.723534 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.723520    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10e16f4-6300-4e16-8f9a-74c6617274ef" containerName="manager"
Sep 10 21:06:24.723586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.723535    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10e16f4-6300-4e16-8f9a-74c6617274ef" containerName="manager"
Sep 10 21:06:24.723621 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.723615    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a10e16f4-6300-4e16-8f9a-74c6617274ef" containerName="manager"
Sep 10 21:06:24.725263 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.725239    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:24.726763 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.726748    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.729270 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.729243    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 21:06:24.730222 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.730199    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:06:24.730222 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.730215    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tww8l\""
Sep 10 21:06:24.737815 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.737787    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"]
Sep 10 21:06:24.787637 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.787591    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:24.795166 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.795143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-maas-api-tls\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.795300 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.795182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0885058-b15d-4ef0-9fbc-24b1df9867de-openshift-service-ca\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.795367 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.795321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jghtl\" (UniqueName: \"kubernetes.io/projected/f0885058-b15d-4ef0-9fbc-24b1df9867de-kube-api-access-jghtl\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.795438 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.795372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-metrics-certs\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.894070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.894035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:24.896228 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.896203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jghtl\" (UniqueName: \"kubernetes.io/projected/f0885058-b15d-4ef0-9fbc-24b1df9867de-kube-api-access-jghtl\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.896381 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.896255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-metrics-certs\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.896381 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.896282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-maas-api-tls\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.896381 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.896336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0885058-b15d-4ef0-9fbc-24b1df9867de-openshift-service-ca\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.897083 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.897065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0885058-b15d-4ef0-9fbc-24b1df9867de-openshift-service-ca\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.898886 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.898863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-metrics-certs\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.898975 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.898889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-maas-api-tls\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:24.904027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:24.904002    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jghtl\" (UniqueName: \"kubernetes.io/projected/f0885058-b15d-4ef0-9fbc-24b1df9867de-kube-api-access-jghtl\") pod \"maas-api-d8489f74-9kx6w\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") " pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:25.039156 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.039060    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:25.128099 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.128068    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:25.229641 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.229603    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:25.233382 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.233348    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"]
Sep 10 21:06:25.236936 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.236918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.239329 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.239306    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 21:06:25.239835 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.239323    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kqq99\""
Sep 10 21:06:25.249035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.249006    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"]
Sep 10 21:06:25.300335 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.300221    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmzs\" (UniqueName: \"kubernetes.io/projected/76ce6e80-7369-403a-94f6-493710bc14e1-kube-api-access-qlmzs\") pod \"payload-pre-processing-59fbc47bf8-j4c88\" (UID: \"76ce6e80-7369-403a-94f6-493710bc14e1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.300335 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.300276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ce6e80-7369-403a-94f6-493710bc14e1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-j4c88\" (UID: \"76ce6e80-7369-403a-94f6-493710bc14e1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.317670 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.317637    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"]
Sep 10 21:06:25.319950 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:06:25.319910    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0885058_b15d_4ef0_9fbc_24b1df9867de.slice/crio-050ab6381d0fb4b4ce414614fa9ef0dea1f86deeb0e55d60a82b3d3aba022ed5 WatchSource:0}: Error finding container 050ab6381d0fb4b4ce414614fa9ef0dea1f86deeb0e55d60a82b3d3aba022ed5: Status 404 returned error can't find the container with id 050ab6381d0fb4b4ce414614fa9ef0dea1f86deeb0e55d60a82b3d3aba022ed5
Sep 10 21:06:25.400875 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.400829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmzs\" (UniqueName: \"kubernetes.io/projected/76ce6e80-7369-403a-94f6-493710bc14e1-kube-api-access-qlmzs\") pod \"payload-pre-processing-59fbc47bf8-j4c88\" (UID: \"76ce6e80-7369-403a-94f6-493710bc14e1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.400875 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.400878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ce6e80-7369-403a-94f6-493710bc14e1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-j4c88\" (UID: \"76ce6e80-7369-403a-94f6-493710bc14e1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.401661 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.401636    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76ce6e80-7369-403a-94f6-493710bc14e1-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-j4c88\" (UID: \"76ce6e80-7369-403a-94f6-493710bc14e1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.409062 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.409029    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmzs\" (UniqueName: \"kubernetes.io/projected/76ce6e80-7369-403a-94f6-493710bc14e1-kube-api-access-qlmzs\") pod \"payload-pre-processing-59fbc47bf8-j4c88\" (UID: \"76ce6e80-7369-403a-94f6-493710bc14e1\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.550466 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.550352    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:25.625440 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.625384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w" event={"ID":"f0885058-b15d-4ef0-9fbc-24b1df9867de","Type":"ContainerStarted","Data":"050ab6381d0fb4b4ce414614fa9ef0dea1f86deeb0e55d60a82b3d3aba022ed5"}
Sep 10 21:06:25.845494 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:25.845464    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"]
Sep 10 21:06:25.847059 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:06:25.847033    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ce6e80_7369_403a_94f6_493710bc14e1.slice/crio-a0ad0baecbad4a8cd7b130b35892fcdc802fce515bf4cb19368c1014de85a128 WatchSource:0}: Error finding container a0ad0baecbad4a8cd7b130b35892fcdc802fce515bf4cb19368c1014de85a128: Status 404 returned error can't find the container with id a0ad0baecbad4a8cd7b130b35892fcdc802fce515bf4cb19368c1014de85a128
Sep 10 21:06:26.639244 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:26.639207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88" event={"ID":"76ce6e80-7369-403a-94f6-493710bc14e1","Type":"ContainerStarted","Data":"a0ad0baecbad4a8cd7b130b35892fcdc802fce515bf4cb19368c1014de85a128"}
Sep 10 21:06:29.658420 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:29.658358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w" event={"ID":"f0885058-b15d-4ef0-9fbc-24b1df9867de","Type":"ContainerStarted","Data":"f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a"}
Sep 10 21:06:29.658935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:29.658581    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:29.660259 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:29.660231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88" event={"ID":"76ce6e80-7369-403a-94f6-493710bc14e1","Type":"ContainerStarted","Data":"82eb6fb0eca7f89a1034fc8f185b6760ab566bc87b83cbfc932e99fc1e240c64"}
Sep 10 21:06:29.660386 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:29.660364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:29.676586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:29.676533    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w" podStartSLOduration=2.016043214 podStartE2EDuration="5.676516134s" totalImagesPullingTime="3.66047292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:06:29.674007259 +0000 UTC m=+512.107837205" watchObservedRunningTime="2026-09-10 21:06:29.676516134 +0000 UTC m=+512.110346083"
Sep 10 21:06:29.689384 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:29.689324    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88" podStartSLOduration=1.483910993 podStartE2EDuration="4.689303892s" totalImagesPullingTime="3.205392899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:06:29.688812833 +0000 UTC m=+512.122642785" watchObservedRunningTime="2026-09-10 21:06:29.689303892 +0000 UTC m=+512.123133844"
Sep 10 21:06:34.234622 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.234579    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jbrvm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:06:34.235035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.234653    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podUID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:06:34.688740 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.688706    2573 generic.go:356] "Generic (PLEG): container finished" podID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerID="ffb99f5cea2e77fb4c2af7aef6bfeae9416f4f45543e4de26e64d56f39f70ad6" exitCode=0
Sep 10 21:06:34.688961 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.688755    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" event={"ID":"2a2233ce-a61b-403a-912e-3eee8c4e8184","Type":"ContainerDied","Data":"ffb99f5cea2e77fb4c2af7aef6bfeae9416f4f45543e4de26e64d56f39f70ad6"}
Sep 10 21:06:34.689174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.689160    2573 scope.go:117] "RemoveContainer" containerID="ffb99f5cea2e77fb4c2af7aef6bfeae9416f4f45543e4de26e64d56f39f70ad6"
Sep 10 21:06:34.690199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.690170    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:06:34.690258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.690245    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:06:34.690298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:34.690286    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:06:35.671269 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:35.671238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:06:35.698157 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:35.698119    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" event={"ID":"2a2233ce-a61b-403a-912e-3eee8c4e8184","Type":"ContainerStarted","Data":"59f6bad24532a3c08b8437df25d206ef7220188fe6174eac6d71266cc3ede7d6"}
Sep 10 21:06:36.637484 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:36.637453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:36.683276 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:36.683241    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:06:36.683683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:36.683497    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jbrvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 10 21:06:36.683683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:36.683547    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podUID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 10 21:06:36.737474 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:36.737439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:37.682999 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:37.682967    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jbrvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 10 21:06:37.683195 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:37.683021    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podUID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 10 21:06:38.682669 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:38.682615    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jbrvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 10 21:06:38.683167 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:38.682690    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podUID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 10 21:06:39.683493 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:39.683452    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jbrvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 10 21:06:39.683903 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:39.683507    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podUID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 10 21:06:40.667898 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:40.667866    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88"
Sep 10 21:06:40.683452 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:40.683391    2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jbrvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 10 21:06:40.683630 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:40.683470    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm" podUID="2a2233ce-a61b-403a-912e-3eee8c4e8184" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 10 21:06:41.686678 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:41.686644    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:06:41.687170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:41.687048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:06:41.687791 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:41.687771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm"
Sep 10 21:06:47.181285 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:47.181234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:52.547426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.547306    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"]
Sep 10 21:06:52.550337 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.550317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.553726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.553706    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 21:06:52.553726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.553718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mtwrf\""
Sep 10 21:06:52.553905 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.553741    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 21:06:52.553905 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.553719    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 21:06:52.560928 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.560902    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"]
Sep 10 21:06:52.567800 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.567770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:06:52.668481 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.668433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.668666 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.668512    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.668666 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.668614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.668772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.668667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.668772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.668691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db73ef0e-2267-40ef-b7ea-6b97e73783d9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.668772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.668741    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27wbf\" (UniqueName: \"kubernetes.io/projected/db73ef0e-2267-40ef-b7ea-6b97e73783d9-kube-api-access-27wbf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.769999 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.769959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27wbf\" (UniqueName: \"kubernetes.io/projected/db73ef0e-2267-40ef-b7ea-6b97e73783d9-kube-api-access-27wbf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770014    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770053    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db73ef0e-2267-40ef-b7ea-6b97e73783d9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770568 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770608    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.770688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.770652    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.772667 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.772644    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db73ef0e-2267-40ef-b7ea-6b97e73783d9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.772851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.772832    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db73ef0e-2267-40ef-b7ea-6b97e73783d9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.777911 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.777886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wbf\" (UniqueName: \"kubernetes.io/projected/db73ef0e-2267-40ef-b7ea-6b97e73783d9-kube-api-access-27wbf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7\" (UID: \"db73ef0e-2267-40ef-b7ea-6b97e73783d9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:52.861935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:52.861900    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:06:53.138638 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:53.138614    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"]
Sep 10 21:06:53.140659 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:06:53.140631    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb73ef0e_2267_40ef_b7ea_6b97e73783d9.slice/crio-613823538c15830e7cb54ba74e498694f30c134dd0811536907ddabbb327e4f2 WatchSource:0}: Error finding container 613823538c15830e7cb54ba74e498694f30c134dd0811536907ddabbb327e4f2: Status 404 returned error can't find the container with id 613823538c15830e7cb54ba74e498694f30c134dd0811536907ddabbb327e4f2
Sep 10 21:06:53.809856 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:53.809817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7" event={"ID":"db73ef0e-2267-40ef-b7ea-6b97e73783d9","Type":"ContainerStarted","Data":"613823538c15830e7cb54ba74e498694f30c134dd0811536907ddabbb327e4f2"}
Sep 10 21:06:54.818190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:54.818149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7" event={"ID":"db73ef0e-2267-40ef-b7ea-6b97e73783d9","Type":"ContainerStarted","Data":"64b2b2b105e3b4044c4b96e754d696939f6c454c622885c396d0ca1738622429"}
Sep 10 21:06:54.834943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:54.834881    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7" podStartSLOduration=1.7399876920000001 podStartE2EDuration="2.834864162s" totalImagesPullingTime="1.09487647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:06:54.833582116 +0000 UTC m=+537.267412067" watchObservedRunningTime="2026-09-10 21:06:54.834864162 +0000 UTC m=+537.268694110"
Sep 10 21:06:58.964181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:06:58.964142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:02.862782 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:02.862739    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:07:02.863272 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:02.862807    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:07:02.875825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:02.875795    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:07:03.874625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:03.874596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7"
Sep 10 21:07:09.064370 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.064329    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"]
Sep 10 21:07:09.069600 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.069579    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.071927 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.071903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 21:07:09.080580 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.080548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"]
Sep 10 21:07:09.089070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.089042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:09.236336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.236298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46b75\" (UniqueName: \"kubernetes.io/projected/e156febd-625f-4192-9906-23ecdc4a26a5-kube-api-access-46b75\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.236509 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.236373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e156febd-625f-4192-9906-23ecdc4a26a5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.236558 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.236507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.236558 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.236549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.236633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.236621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.236670 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.236641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.337755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.337715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.337755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.337759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.337798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.337824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.337852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46b75\" (UniqueName: \"kubernetes.io/projected/e156febd-625f-4192-9906-23ecdc4a26a5-kube-api-access-46b75\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.337941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e156febd-625f-4192-9906-23ecdc4a26a5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338252 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.338198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338310 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.338256    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.338310 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.338300    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.340119 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.340097    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e156febd-625f-4192-9906-23ecdc4a26a5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.340390 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.340373    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e156febd-625f-4192-9906-23ecdc4a26a5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.345355 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.345331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46b75\" (UniqueName: \"kubernetes.io/projected/e156febd-625f-4192-9906-23ecdc4a26a5-kube-api-access-46b75\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk\" (UID: \"e156febd-625f-4192-9906-23ecdc4a26a5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.381585 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.381539    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:09.654353 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.654324    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"]
Sep 10 21:07:09.655940 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:07:09.655905    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode156febd_625f_4192_9906_23ecdc4a26a5.slice/crio-d5e5a30ec19fcd0f3654e18d07675afc7cbfd330aa22b6ddc6a36ad9184751da WatchSource:0}: Error finding container d5e5a30ec19fcd0f3654e18d07675afc7cbfd330aa22b6ddc6a36ad9184751da: Status 404 returned error can't find the container with id d5e5a30ec19fcd0f3654e18d07675afc7cbfd330aa22b6ddc6a36ad9184751da
Sep 10 21:07:09.905170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:09.905128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk" event={"ID":"e156febd-625f-4192-9906-23ecdc4a26a5","Type":"ContainerStarted","Data":"d5e5a30ec19fcd0f3654e18d07675afc7cbfd330aa22b6ddc6a36ad9184751da"}
Sep 10 21:07:10.914964 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:10.914918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk" event={"ID":"e156febd-625f-4192-9906-23ecdc4a26a5","Type":"ContainerStarted","Data":"ecd1f3de189165e1b47e538eb2b0a0911d461bd5f526494a6775754b752a6455"}
Sep 10 21:07:10.932160 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:10.932094    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk" podStartSLOduration=1.7124846759999999 podStartE2EDuration="1.932072954s" totalImagesPullingTime="219.588278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:07:10.931273012 +0000 UTC m=+553.365102963" watchObservedRunningTime="2026-09-10 21:07:10.932072954 +0000 UTC m=+553.365902904"
Sep 10 21:07:17.291987 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:17.291947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:19.382553 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:19.382503    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:19.382975 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:19.382585    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:19.395672 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:19.395635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:19.973228 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:19.973197    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk"
Sep 10 21:07:25.183329 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:25.183295    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:43.365498 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.365457    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"]
Sep 10 21:07:43.370642 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.370614    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.373440 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.373414    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 21:07:43.378748 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.378715    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"]
Sep 10 21:07:43.389349 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.389322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:43.457125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.457088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.457125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.457127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.457429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.457213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.457429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.457321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2rh6\" (UniqueName: \"kubernetes.io/projected/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-kube-api-access-c2rh6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.457429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.457355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.457429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.457378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558052 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2rh6\" (UniqueName: \"kubernetes.io/projected/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-kube-api-access-c2rh6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558236    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558252    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558666 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558630    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558684    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.558781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.558701    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.560699 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.560664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.561033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.561013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.566218 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.566189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2rh6\" (UniqueName: \"kubernetes.io/projected/b0eef350-f71e-49c5-8d4a-2d9aaddc274e-kube-api-access-c2rh6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9scg9\" (UID: \"b0eef350-f71e-49c5-8d4a-2d9aaddc274e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.683524 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.683425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:43.956012 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:43.955982    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"]
Sep 10 21:07:43.957559 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:07:43.957530    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0eef350_f71e_49c5_8d4a_2d9aaddc274e.slice/crio-c2ea3b381815e85d3e24573f5578fc2195187460d1d430e74e3ccb6a49adc911 WatchSource:0}: Error finding container c2ea3b381815e85d3e24573f5578fc2195187460d1d430e74e3ccb6a49adc911: Status 404 returned error can't find the container with id c2ea3b381815e85d3e24573f5578fc2195187460d1d430e74e3ccb6a49adc911
Sep 10 21:07:44.094414 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:44.094372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9" event={"ID":"b0eef350-f71e-49c5-8d4a-2d9aaddc274e","Type":"ContainerStarted","Data":"c2ea3b381815e85d3e24573f5578fc2195187460d1d430e74e3ccb6a49adc911"}
Sep 10 21:07:45.102185 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:45.102145    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9" event={"ID":"b0eef350-f71e-49c5-8d4a-2d9aaddc274e","Type":"ContainerStarted","Data":"1de3b366b395712d11c36e0eb0f134c78e863e09ac269705bfa10adfa38898e2"}
Sep 10 21:07:45.119933 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:45.119884    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9" podStartSLOduration=1.932231867 podStartE2EDuration="2.119868285s" totalImagesPullingTime="187.636418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:07:45.118504463 +0000 UTC m=+587.552334436" watchObservedRunningTime="2026-09-10 21:07:45.119868285 +0000 UTC m=+587.553698231"
Sep 10 21:07:53.684545 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:53.684503    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:53.684955 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:53.684574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:53.697324 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:53.697290    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:54.168246 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:54.168213    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9scg9"
Sep 10 21:07:56.026783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:56.026752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:56.075696 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:56.075661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:57.881670 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:57.881632    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:07:58.013683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:58.013659    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:07:58.013683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:07:58.013688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:08:55.677817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:08:55.677782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:08:56.920168 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:08:56.920138    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:00.866038 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:00.866005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:00.965890 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:00.965854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:01.948591 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:01.948540    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:02.051503 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:02.051465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.018890 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.018844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.123025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.122996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.372842 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.372807    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"]
Sep 10 21:09:17.376728 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.376709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.380640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.380611    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a41a24-openshift-default-dockercfg-mv8sl\""
Sep 10 21:09:17.402670 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.402634    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"]
Sep 10 21:09:17.416599 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.416565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.446769 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.446732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-token\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.446954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.446797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-data\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.446954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.446889    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5lb9\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-kube-api-access-r5lb9\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.446954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.446936    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-podinfo\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.447111 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.447000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istiod-ca-cert\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.447111 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.447025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-certs\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.447217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.447133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-socket\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.447217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.447186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-envoy\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.447325 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.447229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-credential-socket\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5lb9\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-kube-api-access-r5lb9\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-podinfo\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istiod-ca-cert\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-certs\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-socket\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-envoy\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-credential-socket\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-token\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-data\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548771    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-certs\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548792    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-credential-socket\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.548970 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.548950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-socket\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.549065 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.549043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-data\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.549136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.549050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istiod-ca-cert\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.550747 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.550721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-envoy\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.550978 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.550963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-podinfo\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.559346 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.559289    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-token\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.559712 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.559688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5lb9\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-kube-api-access-r5lb9\") pod \"e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") " pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.612200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.612164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:17.688687 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.688588    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:17.970200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.970175    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"]
Sep 10 21:09:17.972703 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:09:17.972677    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6107ffad_ce1a_42a3_98a6_8b0fceae26d2.slice/crio-ce89cf9f3d5656b28b61237e0d027639c815a479de70b474666593120992ad17 WatchSource:0}: Error finding container ce89cf9f3d5656b28b61237e0d027639c815a479de70b474666593120992ad17: Status 404 returned error can't find the container with id ce89cf9f3d5656b28b61237e0d027639c815a479de70b474666593120992ad17
Sep 10 21:09:17.975231 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.975199    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:17.975342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.975269    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:17.975342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:17.975298    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:18.413716 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.413675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:18.513670 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.513639    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:18.607154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.607115    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" event={"ID":"6107ffad-ce1a-42a3-98a6-8b0fceae26d2","Type":"ContainerStarted","Data":"20adc5e79a38f060b08b7c1ad5b7e1ceb88090720690eab69942c95b7a153e17"}
Sep 10 21:09:18.607369 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.607207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" event={"ID":"6107ffad-ce1a-42a3-98a6-8b0fceae26d2","Type":"ContainerStarted","Data":"ce89cf9f3d5656b28b61237e0d027639c815a479de70b474666593120992ad17"}
Sep 10 21:09:18.630061 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.630000    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podStartSLOduration=1.629978148 podStartE2EDuration="1.629978148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:18.629218148 +0000 UTC m=+681.063048097" watchObservedRunningTime="2026-09-10 21:09:18.629978148 +0000 UTC m=+681.063808098"
Sep 10 21:09:18.688814 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.688719    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:18.830545 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:18.830510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:19.694267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:19.694238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:20.504647 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:20.504605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:20.594793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:20.594757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:20.620991 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:20.620962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:20.622065 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:20.622039    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:21.092088 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.092053    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:21.192473 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.192436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:21.614543 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.614505    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"]
Sep 10 21:09:21.618664 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.618639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.621289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.621264    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a41a24-serving-cert\""
Sep 10 21:09:21.630720 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.630693    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"]
Sep 10 21:09:21.646205 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.646175    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:21.746287 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.746252    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:21.788552 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.788515    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mzkz\" (UniqueName: \"kubernetes.io/projected/e8ee9d70-0c52-49fc-832c-97004c805a0f-kube-api-access-9mzkz\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.788552 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.788555    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-metrics-certs\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.788761 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.788591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.788761 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.788717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ee9d70-0c52-49fc-832c-97004c805a0f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.876555 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.876472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:21.889469 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.889438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ee9d70-0c52-49fc-832c-97004c805a0f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.889562 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.889527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mzkz\" (UniqueName: \"kubernetes.io/projected/e8ee9d70-0c52-49fc-832c-97004c805a0f-kube-api-access-9mzkz\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.889634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.889558    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-metrics-certs\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.889634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.889611    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.890115 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.890094    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ee9d70-0c52-49fc-832c-97004c805a0f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.892050 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.892028    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-metrics-certs\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.892143 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.892086    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.898001 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.897975    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mzkz\" (UniqueName: \"kubernetes.io/projected/e8ee9d70-0c52-49fc-832c-97004c805a0f-kube-api-access-9mzkz\") pod \"maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:21.933704 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:21.933673    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:22.119911 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:22.119881    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:22.210093 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:22.210064    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"]
Sep 10 21:09:22.210751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:22.210716    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:22.211613 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:09:22.211588    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ee9d70_0c52_49fc_832c_97004c805a0f.slice/crio-3f21713a4636ef3e0f01e3d9919e1a4abf920272e28832edc4d2d3b98eedcca6 WatchSource:0}: Error finding container 3f21713a4636ef3e0f01e3d9919e1a4abf920272e28832edc4d2d3b98eedcca6: Status 404 returned error can't find the container with id 3f21713a4636ef3e0f01e3d9919e1a4abf920272e28832edc4d2d3b98eedcca6
Sep 10 21:09:22.213045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:22.213029    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:09:22.634477 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:22.634440    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw" event={"ID":"e8ee9d70-0c52-49fc-832c-97004c805a0f","Type":"ContainerStarted","Data":"3f21713a4636ef3e0f01e3d9919e1a4abf920272e28832edc4d2d3b98eedcca6"}
Sep 10 21:09:23.640892 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:23.640856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw" event={"ID":"e8ee9d70-0c52-49fc-832c-97004c805a0f","Type":"ContainerStarted","Data":"78b767ed643ec6d75163c74bb1f78f9d1d144f813144a6a52d87de8f2fef6a9e"}
Sep 10 21:09:23.641299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:23.640978    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:23.657826 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:23.657773    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw" podStartSLOduration=2.244318617 podStartE2EDuration="2.657754165s" totalImagesPullingTime="413.435548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:23.65617225 +0000 UTC m=+686.090002201" watchObservedRunningTime="2026-09-10 21:09:23.657754165 +0000 UTC m=+686.091584114"
Sep 10 21:09:24.113759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:24.113721    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:24.636774 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:24.636743    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:24.736974 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:24.736936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:24.858171 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:24.858139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:25.216616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:25.216582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:25.346307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:25.346270    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:25.526074 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:25.525982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:25.863134 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:25.863079    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:26.135589 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:26.135485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:27.984625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:27.984590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:28.084642 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:28.084604    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:28.524830 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:28.524785    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:28.620711 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:28.620672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.143040 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.143008    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"]
Sep 10 21:09:29.146903 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.146876    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.149494 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.149472    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0827ee43-serving-cert\""
Sep 10 21:09:29.157938 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.157850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"]
Sep 10 21:09:29.199217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.199185    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.263658 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.263604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ml29\" (UniqueName: \"kubernetes.io/projected/1aa80603-cf54-49f6-93bd-5982c2b1793c-kube-api-access-6ml29\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.263853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.263710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa80603-cf54-49f6-93bd-5982c2b1793c-openshift-service-ca\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.263918 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.263862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-maas-api-tls\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.263918 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.263897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-metrics-certs\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.304677 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.304641    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.364566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.364528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ml29\" (UniqueName: \"kubernetes.io/projected/1aa80603-cf54-49f6-93bd-5982c2b1793c-kube-api-access-6ml29\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.364759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.364591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa80603-cf54-49f6-93bd-5982c2b1793c-openshift-service-ca\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.364759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.364645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-maas-api-tls\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.364759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.364668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-metrics-certs\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.365269 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.365232    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa80603-cf54-49f6-93bd-5982c2b1793c-openshift-service-ca\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.367136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.367116    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-maas-api-tls\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.367247 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.367161    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-metrics-certs\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.372390 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.372360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ml29\" (UniqueName: \"kubernetes.io/projected/1aa80603-cf54-49f6-93bd-5982c2b1793c-kube-api-access-6ml29\") pod \"maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.400902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.400824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.463308 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.463263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:29.516056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.515975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.624436 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.624176    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.652847 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.652771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:09:29.739422 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.737117    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.774088 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.774040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"]
Sep 10 21:09:29.776646 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:09:29.776616    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa80603_cf54_49f6_93bd_5982c2b1793c.slice/crio-07b12af6028fccf07897c104dfb39fc754afb07164219a56b9c6dff0079d840d WatchSource:0}: Error finding container 07b12af6028fccf07897c104dfb39fc754afb07164219a56b9c6dff0079d840d: Status 404 returned error can't find the container with id 07b12af6028fccf07897c104dfb39fc754afb07164219a56b9c6dff0079d840d
Sep 10 21:09:29.820198 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.820080    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:29.929489 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:29.929199    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:30.295950 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.295913    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"]
Sep 10 21:09:30.300103 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.300078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.314423 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.306752    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-94604f-serving-cert\""
Sep 10 21:09:30.328425 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.317011    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"]
Sep 10 21:09:30.337426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.334311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:30.438063 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.437947    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:30.484132 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.484096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-openshift-service-ca\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.484316 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.484149    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-maas-api-tls\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.484316 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.484267    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6s5w\" (UniqueName: \"kubernetes.io/projected/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-kube-api-access-s6s5w\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.484316 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.484290    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-metrics-certs\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.540806 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.540766    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:30.585530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.585494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-openshift-service-ca\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.585683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.585539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-maas-api-tls\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.585683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.585636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6s5w\" (UniqueName: \"kubernetes.io/projected/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-kube-api-access-s6s5w\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.585683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.585668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-metrics-certs\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.586283 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.586261    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-openshift-service-ca\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.588156 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.588127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-maas-api-tls\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.588249 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.588168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-metrics-certs\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.596024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.595999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6s5w\" (UniqueName: \"kubernetes.io/projected/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-kube-api-access-s6s5w\") pod \"maas-api-e2e-autores-94604f-644b878b77-ppwv8\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.634544 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.634504    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:30.678986 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.678949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96" event={"ID":"1aa80603-cf54-49f6-93bd-5982c2b1793c","Type":"ContainerStarted","Data":"ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6"}
Sep 10 21:09:30.679163 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.679007    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96" event={"ID":"1aa80603-cf54-49f6-93bd-5982c2b1793c","Type":"ContainerStarted","Data":"07b12af6028fccf07897c104dfb39fc754afb07164219a56b9c6dff0079d840d"}
Sep 10 21:09:30.679163 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.679064    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:30.699452 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.698929    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96" podStartSLOduration=1.308357124 podStartE2EDuration="1.698904678s" totalImagesPullingTime="390.547554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:30.695808564 +0000 UTC m=+693.129638513" watchObservedRunningTime="2026-09-10 21:09:30.698904678 +0000 UTC m=+693.132734628"
Sep 10 21:09:30.943469 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.931386    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"]
Sep 10 21:09:30.943891 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:30.943680    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:31.040813 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:31.040781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:31.535931 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:31.535890    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:31.686330 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:31.686294    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8" event={"ID":"124880d0-0ec6-46cf-b32c-e7c6ef49e2de","Type":"ContainerStarted","Data":"74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7"}
Sep 10 21:09:31.686538 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:31.686353    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8" event={"ID":"124880d0-0ec6-46cf-b32c-e7c6ef49e2de","Type":"ContainerStarted","Data":"6ef3b8444e1f95334254e118e993c9dbda63b33ee25d4b53121c87c0ec52ff07"}
Sep 10 21:09:31.708808 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:31.708748    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8" podStartSLOduration=1.299221551 podStartE2EDuration="1.708700555s" totalImagesPullingTime="409.479004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:31.704849705 +0000 UTC m=+694.138679655" watchObservedRunningTime="2026-09-10 21:09:31.708700555 +0000 UTC m=+694.142530506"
Sep 10 21:09:32.305573 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:32.305507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:32.699315 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:32.693747    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:35.423060 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.423028    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.524043 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.524006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.622638 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.622605    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:35.622806 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.622660    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:35.627449 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.627424    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.713118 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.713032    2573 generic.go:356] "Generic (PLEG): container finished" podID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerID="20adc5e79a38f060b08b7c1ad5b7e1ceb88090720690eab69942c95b7a153e17" exitCode=0
Sep 10 21:09:35.713118 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.713111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" event={"ID":"6107ffad-ce1a-42a3-98a6-8b0fceae26d2","Type":"ContainerDied","Data":"20adc5e79a38f060b08b7c1ad5b7e1ceb88090720690eab69942c95b7a153e17"}
Sep 10 21:09:35.713646 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.713627    2573 scope.go:117] "RemoveContainer" containerID="20adc5e79a38f060b08b7c1ad5b7e1ceb88090720690eab69942c95b7a153e17"
Sep 10 21:09:35.714876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.714845    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:35.714977 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.714942    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:35.715041 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.714999    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:35.728433 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.728344    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.824972 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.824939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:35.924263 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:35.924228    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:36.025273 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:36.025173    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:36.691859 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:36.691828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:09:36.721239 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:36.721204    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" event={"ID":"6107ffad-ce1a-42a3-98a6-8b0fceae26d2","Type":"ContainerStarted","Data":"00ce9f8e8fd09199ea8ecd6ad4f5d942abbef76d1575a9f53e0d76a03879ce61"}
Sep 10 21:09:37.689702 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:37.689666    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:37.689894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:37.689859    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:37.689940 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:37.689917    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:38.481967 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:38.481933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:38.688961 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:38.688926    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:38.689133 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:38.688981    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:38.705734 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:38.705703    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:09:39.689427 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:39.689369    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:39.689828 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:39.689483    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:40.385556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:40.385516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:40.581025 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:40.580992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:40.689778 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:40.689695    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:40.689778 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:40.689759    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:41.594617 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:41.594583    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:41.689456 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:41.689424    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:41.689651 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:41.689481    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:41.694487 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:41.694460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:42.689566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:42.689526    2573 patch_prober.go:28] interesting pod/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 21:09:42.689760 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:42.689584    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 21:09:42.805409 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:42.805357    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:43.694234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:43.694199    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:43.694754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:43.694726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:43.695417 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:43.695381    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:09:45.395702 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:45.395670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:45.707754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:45.707652    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:45.989640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:45.989536    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"]
Sep 10 21:09:45.993876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:45.993849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:45.996216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:45.996189    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-69dcc8-openshift-default-dockercfg-j2hnx\""
Sep 10 21:09:46.004910 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.004879    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"]
Sep 10 21:09:46.021503 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.021469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:46.044841 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.044815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-socket\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.044983 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.044846    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lhmm\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-kube-api-access-6lhmm\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.044983 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.044880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-credential-socket\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.044983 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.044935    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-certs\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.045107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.045013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-token\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.045107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.045033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-envoy\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.045107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.045050    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istiod-ca-cert\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.045107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.045082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-podinfo\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.045107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.045102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-data\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146309 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-credential-socket\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146309 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-certs\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146391    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-token\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146466    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-envoy\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istiod-ca-cert\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-podinfo\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-data\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146648 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-socket\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146655    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lhmm\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-kube-api-access-6lhmm\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146754    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-certs\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.146963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146812    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-credential-socket\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.147111 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.146990    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-data\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.147226 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.147202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istiod-ca-cert\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.147334 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.147314    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-socket\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.148772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.148753    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-envoy\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.149165 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.149129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-podinfo\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.154459 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.154434    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-token\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.154752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.154732    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lhmm\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-kube-api-access-6lhmm\") pod \"e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") " pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.224752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.224713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:46.308512 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.308410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:46.587367 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.587269    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"]
Sep 10 21:09:46.590105 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:09:46.590079    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3575cbe_ca7e_47d4_a0bd_877f4b0902b1.slice/crio-0c0415fab25cfc5a17848ef075371474f8c0e0460bcd3279b9fa549f942fe298 WatchSource:0}: Error finding container 0c0415fab25cfc5a17848ef075371474f8c0e0460bcd3279b9fa549f942fe298: Status 404 returned error can't find the container with id 0c0415fab25cfc5a17848ef075371474f8c0e0460bcd3279b9fa549f942fe298
Sep 10 21:09:46.592597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.592567    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:46.592677 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.592651    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:46.592725 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.592676    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:09:46.786807 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.786769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" event={"ID":"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1","Type":"ContainerStarted","Data":"20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"}
Sep 10 21:09:46.786999 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.786831    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" event={"ID":"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1","Type":"ContainerStarted","Data":"0c0415fab25cfc5a17848ef075371474f8c0e0460bcd3279b9fa549f942fe298"}
Sep 10 21:09:46.880597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:46.880488    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podStartSLOduration=1.880470984 podStartE2EDuration="1.880470984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:46.877578543 +0000 UTC m=+709.311408502" watchObservedRunningTime="2026-09-10 21:09:46.880470984 +0000 UTC m=+709.314301013"
Sep 10 21:09:47.309117 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:47.309021    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:47.314643 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:47.314616    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:47.791965 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:47.791930    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:47.792943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:47.792926    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:09:48.741343 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:48.741309    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:48.841689 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:48.841654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:49.888062 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.888026    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"]
Sep 10 21:09:49.893614 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.893582    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:49.895818 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.895792    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-69dcc8-serving-cert\""
Sep 10 21:09:49.902266 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.902239    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"]
Sep 10 21:09:49.920788 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.920741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:49.985408 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.985349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-metrics-certs\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:49.985605 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.985509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:49.985605 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.985564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52kc\" (UniqueName: \"kubernetes.io/projected/cea27791-2254-4ba8-be60-61e03cac81ef-kube-api-access-f52kc\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:49.985605 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:49.985596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea27791-2254-4ba8-be60-61e03cac81ef-openshift-service-ca\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.026528 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.026436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:50.086919 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.086881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.087120 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.086931    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52kc\" (UniqueName: \"kubernetes.io/projected/cea27791-2254-4ba8-be60-61e03cac81ef-kube-api-access-f52kc\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.087120 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.086953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea27791-2254-4ba8-be60-61e03cac81ef-openshift-service-ca\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.087120 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.087016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-metrics-certs\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.087294 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:09:50.087258    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-serving-cert: secret "maas-api-e2e-inf-b-69dcc8-serving-cert" not found
Sep 10 21:09:50.087343 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:09:50.087335    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls podName:cea27791-2254-4ba8-be60-61e03cac81ef nodeName:}" failed. No retries permitted until 2026-09-10 21:09:50.587312467 +0000 UTC m=+713.021142396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls") pod "maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" (UID: "cea27791-2254-4ba8-be60-61e03cac81ef") : secret "maas-api-e2e-inf-b-69dcc8-serving-cert" not found
Sep 10 21:09:50.087793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.087773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea27791-2254-4ba8-be60-61e03cac81ef-openshift-service-ca\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.089552 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.089530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-metrics-certs\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.095646 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.095613    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52kc\" (UniqueName: \"kubernetes.io/projected/cea27791-2254-4ba8-be60-61e03cac81ef-kube-api-access-f52kc\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.244530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.244436    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:50.500114 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.500022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:50.591202 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.591161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.593839 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.593808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.597097 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.597050    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:50.812931 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.812844    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:50.984565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:50.984530    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.093983 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:51.093958    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"]
Sep 10 21:09:51.096134 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:09:51.096103    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea27791_2254_4ba8_be60_61e03cac81ef.slice/crio-fd8faad28c54fbbff9f53e176b84b19b7756ffbf76f413551d4772910f455249 WatchSource:0}: Error finding container fd8faad28c54fbbff9f53e176b84b19b7756ffbf76f413551d4772910f455249: Status 404 returned error can't find the container with id fd8faad28c54fbbff9f53e176b84b19b7756ffbf76f413551d4772910f455249
Sep 10 21:09:51.685133 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:51.685102    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:51.824575 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:51.824539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" event={"ID":"cea27791-2254-4ba8-be60-61e03cac81ef","Type":"ContainerStarted","Data":"943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a"}
Sep 10 21:09:51.824766 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:51.824606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" event={"ID":"cea27791-2254-4ba8-be60-61e03cac81ef","Type":"ContainerStarted","Data":"fd8faad28c54fbbff9f53e176b84b19b7756ffbf76f413551d4772910f455249"}
Sep 10 21:09:51.824766 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:51.824635    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:09:51.845641 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:51.845586    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" podStartSLOduration=2.464074097 podStartE2EDuration="2.845571877s" totalImagesPullingTime="381.49778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:09:51.844479594 +0000 UTC m=+714.278309545" watchObservedRunningTime="2026-09-10 21:09:51.845571877 +0000 UTC m=+714.279401826"
Sep 10 21:09:52.428233 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:52.428200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:53.097297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:53.097265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:53.418594 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:53.418478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:53.785823 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:53.785727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:54.583713 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:54.583681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:09:57.835718 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:09:57.835692    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:10:07.921679 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:07.921642    2573 generic.go:356] "Generic (PLEG): container finished" podID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerID="20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb" exitCode=0
Sep 10 21:10:07.922199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:07.921723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" event={"ID":"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1","Type":"ContainerDied","Data":"20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"}
Sep 10 21:10:07.922317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:07.922300    2573 scope.go:117] "RemoveContainer" containerID="20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"
Sep 10 21:10:07.923577 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:07.923548    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:10:07.923660 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:07.923636    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:10:07.923698 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:07.923686    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:10:08.929368 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:08.929327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" event={"ID":"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1","Type":"ContainerStarted","Data":"39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6"}
Sep 10 21:10:09.309026 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:09.308923    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:10:09.309370 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:09.309340    2573 patch_prober.go:28] interesting pod/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:09.309640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:09.309612    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 21:10:09.892814 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:09.892773    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"]
Sep 10 21:10:09.893236 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:09.893202    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96" podUID="1aa80603-cf54-49f6-93bd-5982c2b1793c" containerName="maas-api" containerID="cri-o://ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6" gracePeriod=30
Sep 10 21:10:09.941331 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:09.941279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.081815 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.081750    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.176566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.176463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.254420 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.254376    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:10:10.263639 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.263611    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.318062 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.317566    2573 patch_prober.go:28] interesting pod/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:10.318062 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.317634    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 21:10:10.326428 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.326319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.347280 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.347253    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-metrics-certs\") pod \"1aa80603-cf54-49f6-93bd-5982c2b1793c\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") "
Sep 10 21:10:10.347566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.347546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-maas-api-tls\") pod \"1aa80603-cf54-49f6-93bd-5982c2b1793c\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") "
Sep 10 21:10:10.347647 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.347627    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa80603-cf54-49f6-93bd-5982c2b1793c-openshift-service-ca\") pod \"1aa80603-cf54-49f6-93bd-5982c2b1793c\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") "
Sep 10 21:10:10.347905 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.347706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ml29\" (UniqueName: \"kubernetes.io/projected/1aa80603-cf54-49f6-93bd-5982c2b1793c-kube-api-access-6ml29\") pod \"1aa80603-cf54-49f6-93bd-5982c2b1793c\" (UID: \"1aa80603-cf54-49f6-93bd-5982c2b1793c\") "
Sep 10 21:10:10.348186 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.348134    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa80603-cf54-49f6-93bd-5982c2b1793c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1aa80603-cf54-49f6-93bd-5982c2b1793c" (UID: "1aa80603-cf54-49f6-93bd-5982c2b1793c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:10.349900 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.349869    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa80603-cf54-49f6-93bd-5982c2b1793c-kube-api-access-6ml29" (OuterVolumeSpecName: "kube-api-access-6ml29") pod "1aa80603-cf54-49f6-93bd-5982c2b1793c" (UID: "1aa80603-cf54-49f6-93bd-5982c2b1793c"). InnerVolumeSpecName "kube-api-access-6ml29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:10.349972 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.349904    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1aa80603-cf54-49f6-93bd-5982c2b1793c" (UID: "1aa80603-cf54-49f6-93bd-5982c2b1793c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:10:10.350749 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.350726    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1aa80603-cf54-49f6-93bd-5982c2b1793c" (UID: "1aa80603-cf54-49f6-93bd-5982c2b1793c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:10:10.435482 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.435248    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.448723 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.448691    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa80603-cf54-49f6-93bd-5982c2b1793c-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:10.448723 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.448721    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ml29\" (UniqueName: \"kubernetes.io/projected/1aa80603-cf54-49f6-93bd-5982c2b1793c-kube-api-access-6ml29\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:10.448723 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.448732    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:10.448960 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.448742    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa80603-cf54-49f6-93bd-5982c2b1793c-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:10.890680 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.890574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.957083 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.957055    2573 generic.go:356] "Generic (PLEG): container finished" podID="1aa80603-cf54-49f6-93bd-5982c2b1793c" containerID="ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6" exitCode=0
Sep 10 21:10:10.957511 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.957116    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"
Sep 10 21:10:10.957511 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.957143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96" event={"ID":"1aa80603-cf54-49f6-93bd-5982c2b1793c","Type":"ContainerDied","Data":"ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6"}
Sep 10 21:10:10.957511 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.957202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96" event={"ID":"1aa80603-cf54-49f6-93bd-5982c2b1793c","Type":"ContainerDied","Data":"07b12af6028fccf07897c104dfb39fc754afb07164219a56b9c6dff0079d840d"}
Sep 10 21:10:10.957511 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.957231    2573 scope.go:117] "RemoveContainer" containerID="ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6"
Sep 10 21:10:10.967978 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.967963    2573 scope.go:117] "RemoveContainer" containerID="ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6"
Sep 10 21:10:10.968289 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:10:10.968269    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6\": container with ID starting with ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6 not found: ID does not exist" containerID="ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6"
Sep 10 21:10:10.968360 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.968301    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6"} err="failed to get container status \"ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6\": rpc error: code = NotFound desc = could not find container \"ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6\": container with ID starting with ecf645083c6500c8c4a1529862e0a259dc77d94513fd3cc6fc069721ae7e1fd6 not found: ID does not exist"
Sep 10 21:10:10.982098 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.982073    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"]
Sep 10 21:10:10.986598 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.986571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:10.987926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:10.987909    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0827ee43-bfcdf7899-vcn96"]
Sep 10 21:10:11.055846 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:11.055807    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:11.155607 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:11.155528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:11.309795 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:11.309757    2573 patch_prober.go:28] interesting pod/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:11.310004 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:11.309825    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 21:10:11.398146 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:11.398118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:11.813962 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:11.813923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:12.044287 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:12.044251    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa80603-cf54-49f6-93bd-5982c2b1793c" path="/var/lib/kubelet/pods/1aa80603-cf54-49f6-93bd-5982c2b1793c/volumes"
Sep 10 21:10:12.309041 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:12.308993    2573 patch_prober.go:28] interesting pod/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:12.309855 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:12.309062    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 21:10:13.309928 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:13.309891    2573 patch_prober.go:28] interesting pod/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:13.310918 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:13.310519    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 21:10:13.675887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:13.675848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.309608 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.309103    2573 patch_prober.go:28] interesting pod/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 10 21:10:14.309608 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.309183    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 10 21:10:14.512817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.512777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.609813 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.609780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.664611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.664574    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"]
Sep 10 21:10:14.665278 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.665262    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa80603-cf54-49f6-93bd-5982c2b1793c" containerName="maas-api"
Sep 10 21:10:14.665342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.665282    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa80603-cf54-49f6-93bd-5982c2b1793c" containerName="maas-api"
Sep 10 21:10:14.665519 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.665505    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa80603-cf54-49f6-93bd-5982c2b1793c" containerName="maas-api"
Sep 10 21:10:14.670716 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.670687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.676805 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.676774    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c2ec79e5-serving-cert\""
Sep 10 21:10:14.679370 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.678537    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"]
Sep 10 21:10:14.694006 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.693971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb9c7ee-733d-4696-b479-1d1a1795d367-openshift-service-ca\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.694325 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.694297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-maas-api-tls\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.694499 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.694471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-metrics-certs\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.694587 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.694569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhn24\" (UniqueName: \"kubernetes.io/projected/8eb9c7ee-733d-4696-b479-1d1a1795d367-kube-api-access-nhn24\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.702138 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.702106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.765508 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.765472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.795473 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.795432    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb9c7ee-733d-4696-b479-1d1a1795d367-openshift-service-ca\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.795652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.795499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-maas-api-tls\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.795652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.795572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-metrics-certs\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.795652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.795630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhn24\" (UniqueName: \"kubernetes.io/projected/8eb9c7ee-733d-4696-b479-1d1a1795d367-kube-api-access-nhn24\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.796346 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.796317    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb9c7ee-733d-4696-b479-1d1a1795d367-openshift-service-ca\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.798187 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.798168    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-maas-api-tls\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.798274 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.798210    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-metrics-certs\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.804613 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.804582    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhn24\" (UniqueName: \"kubernetes.io/projected/8eb9c7ee-733d-4696-b479-1d1a1795d367-kube-api-access-nhn24\") pod \"maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:14.867858 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.867724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:14.990426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:14.990365    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:15.166024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.165942    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:15.273588 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.273554    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"]
Sep 10 21:10:15.274035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.274006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:15.275527 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:10:15.275503    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb9c7ee_733d_4696_b479_1d1a1795d367.slice/crio-93ecac105ff56441f4c52182f5b1a401ec79325f30114875bcaf42b80476e75d WatchSource:0}: Error finding container 93ecac105ff56441f4c52182f5b1a401ec79325f30114875bcaf42b80476e75d: Status 404 returned error can't find the container with id 93ecac105ff56441f4c52182f5b1a401ec79325f30114875bcaf42b80476e75d
Sep 10 21:10:15.314883 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.314853    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:10:15.315336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.315313    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:10:15.316280 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.316247    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:10:15.989124 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.989008    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w" event={"ID":"8eb9c7ee-733d-4696-b479-1d1a1795d367","Type":"ContainerStarted","Data":"daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a"}
Sep 10 21:10:15.989124 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.989101    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w" event={"ID":"8eb9c7ee-733d-4696-b479-1d1a1795d367","Type":"ContainerStarted","Data":"93ecac105ff56441f4c52182f5b1a401ec79325f30114875bcaf42b80476e75d"}
Sep 10 21:10:15.989696 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:15.989543    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:16.007835 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:16.007779    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w" podStartSLOduration=1.626196865 podStartE2EDuration="2.007762104s" totalImagesPullingTime="381.565239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:16.004071483 +0000 UTC m=+738.437901433" watchObservedRunningTime="2026-09-10 21:10:16.007762104 +0000 UTC m=+738.441592053"
Sep 10 21:10:19.949729 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:19.949697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:22.000056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:22.000030    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:30.361635 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:30.361602    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:45.451909 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:45.451871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:46.087032 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.087001    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"]
Sep 10 21:10:46.087315 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.087280    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w" podUID="8eb9c7ee-733d-4696-b479-1d1a1795d367" containerName="maas-api" containerID="cri-o://daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a" gracePeriod=30
Sep 10 21:10:46.120559 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.120529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:46.220993 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.220963    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:46.311377 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.311332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:46.353277 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.353211    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:46.374243 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.374210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:46.426759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.426731    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-metrics-certs\") pod \"8eb9c7ee-733d-4696-b479-1d1a1795d367\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") "
Sep 10 21:10:46.426938 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.426794    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-maas-api-tls\") pod \"8eb9c7ee-733d-4696-b479-1d1a1795d367\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") "
Sep 10 21:10:46.426938 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.426821    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhn24\" (UniqueName: \"kubernetes.io/projected/8eb9c7ee-733d-4696-b479-1d1a1795d367-kube-api-access-nhn24\") pod \"8eb9c7ee-733d-4696-b479-1d1a1795d367\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") "
Sep 10 21:10:46.426938 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.426899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb9c7ee-733d-4696-b479-1d1a1795d367-openshift-service-ca\") pod \"8eb9c7ee-733d-4696-b479-1d1a1795d367\" (UID: \"8eb9c7ee-733d-4696-b479-1d1a1795d367\") "
Sep 10 21:10:46.427555 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.427518    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb9c7ee-733d-4696-b479-1d1a1795d367-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8eb9c7ee-733d-4696-b479-1d1a1795d367" (UID: "8eb9c7ee-733d-4696-b479-1d1a1795d367"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:10:46.430481 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.430456    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8eb9c7ee-733d-4696-b479-1d1a1795d367" (UID: "8eb9c7ee-733d-4696-b479-1d1a1795d367"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:10:46.431754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.431724    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb9c7ee-733d-4696-b479-1d1a1795d367-kube-api-access-nhn24" (OuterVolumeSpecName: "kube-api-access-nhn24") pod "8eb9c7ee-733d-4696-b479-1d1a1795d367" (UID: "8eb9c7ee-733d-4696-b479-1d1a1795d367"). InnerVolumeSpecName "kube-api-access-nhn24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:10:46.431855 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.431774    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8eb9c7ee-733d-4696-b479-1d1a1795d367" (UID: "8eb9c7ee-733d-4696-b479-1d1a1795d367"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:10:46.465536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.465488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:46.528023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.527989    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:46.528023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.528018    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eb9c7ee-733d-4696-b479-1d1a1795d367-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:46.528023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.528027    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhn24\" (UniqueName: \"kubernetes.io/projected/8eb9c7ee-733d-4696-b479-1d1a1795d367-kube-api-access-nhn24\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:46.528268 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.528038    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eb9c7ee-733d-4696-b479-1d1a1795d367-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:10:46.891418 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:46.891371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:47.169438 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.169286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:47.171842 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.171811    2573 generic.go:356] "Generic (PLEG): container finished" podID="8eb9c7ee-733d-4696-b479-1d1a1795d367" containerID="daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a" exitCode=0
Sep 10 21:10:47.171976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.171875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w" event={"ID":"8eb9c7ee-733d-4696-b479-1d1a1795d367","Type":"ContainerDied","Data":"daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a"}
Sep 10 21:10:47.171976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.171923    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"
Sep 10 21:10:47.171976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.171938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w" event={"ID":"8eb9c7ee-733d-4696-b479-1d1a1795d367","Type":"ContainerDied","Data":"93ecac105ff56441f4c52182f5b1a401ec79325f30114875bcaf42b80476e75d"}
Sep 10 21:10:47.171976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.171967    2573 scope.go:117] "RemoveContainer" containerID="daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a"
Sep 10 21:10:47.184992 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.184969    2573 scope.go:117] "RemoveContainer" containerID="daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a"
Sep 10 21:10:47.185298 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:10:47.185279    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a\": container with ID starting with daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a not found: ID does not exist" containerID="daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a"
Sep 10 21:10:47.185382 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.185304    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a"} err="failed to get container status \"daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a\": rpc error: code = NotFound desc = could not find container \"daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a\": container with ID starting with daad2d26f4cdc74348a3c1abfdbfaad12071889bc358bc7cbf235630b200f35a not found: ID does not exist"
Sep 10 21:10:47.198716 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.198662    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"]
Sep 10 21:10:47.201053 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.201020    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c2ec79e5-8bcf97f69-5wx2w"]
Sep 10 21:10:47.271452 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:47.271418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:48.044217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:48.044187    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb9c7ee-733d-4696-b479-1d1a1795d367" path="/var/lib/kubelet/pods/8eb9c7ee-733d-4696-b479-1d1a1795d367/volumes"
Sep 10 21:10:49.266944 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:49.266910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:49.563968 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:49.563869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:49.653041 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:49.653009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:50.852849 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.852803    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"]
Sep 10 21:10:50.853661 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.853635    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb9c7ee-733d-4696-b479-1d1a1795d367" containerName="maas-api"
Sep 10 21:10:50.853847 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.853832    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb9c7ee-733d-4696-b479-1d1a1795d367" containerName="maas-api"
Sep 10 21:10:50.854082 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.854066    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb9c7ee-733d-4696-b479-1d1a1795d367" containerName="maas-api"
Sep 10 21:10:50.859534 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.859505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:50.863253 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.862933    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1992fc41-serving-cert\""
Sep 10 21:10:50.865290 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.865260    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"]
Sep 10 21:10:50.886947 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.886912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:50.954955 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.954910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:50.978337 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.978298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54z6s\" (UniqueName: \"kubernetes.io/projected/d665dd98-9d3a-4647-8dba-4f3a4719fe20-kube-api-access-54z6s\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:50.978551 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.978384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-metrics-certs\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:50.978551 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.978477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d665dd98-9d3a-4647-8dba-4f3a4719fe20-openshift-service-ca\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:50.978551 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:50.978500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-maas-api-tls\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.079534 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.079492    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54z6s\" (UniqueName: \"kubernetes.io/projected/d665dd98-9d3a-4647-8dba-4f3a4719fe20-kube-api-access-54z6s\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.079760 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.079594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-metrics-certs\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.079760 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.079642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d665dd98-9d3a-4647-8dba-4f3a4719fe20-openshift-service-ca\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.079760 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.079677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-maas-api-tls\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.080435 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.080376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d665dd98-9d3a-4647-8dba-4f3a4719fe20-openshift-service-ca\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.082216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.082193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-maas-api-tls\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.082314 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.082247    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-metrics-certs\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.087216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.087184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54z6s\" (UniqueName: \"kubernetes.io/projected/d665dd98-9d3a-4647-8dba-4f3a4719fe20-kube-api-access-54z6s\") pod \"maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.089354 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.089330    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:51.174208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.174110    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:51.403243 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.403210    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:51.453922 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.453897    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"]
Sep 10 21:10:51.457027 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:10:51.456996    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd665dd98_9d3a_4647_8dba_4f3a4719fe20.slice/crio-95f439d1cbb38c15869f26d9754004afba1b9e22dd125b5ef9a14693fed88a01 WatchSource:0}: Error finding container 95f439d1cbb38c15869f26d9754004afba1b9e22dd125b5ef9a14693fed88a01: Status 404 returned error can't find the container with id 95f439d1cbb38c15869f26d9754004afba1b9e22dd125b5ef9a14693fed88a01
Sep 10 21:10:51.503701 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.503663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:51.673902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:51.673865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:52.213289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:52.213183    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp" event={"ID":"d665dd98-9d3a-4647-8dba-4f3a4719fe20","Type":"ContainerStarted","Data":"cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8"}
Sep 10 21:10:52.213289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:52.213247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp" event={"ID":"d665dd98-9d3a-4647-8dba-4f3a4719fe20","Type":"ContainerStarted","Data":"95f439d1cbb38c15869f26d9754004afba1b9e22dd125b5ef9a14693fed88a01"}
Sep 10 21:10:52.213793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:52.213423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:10:52.228822 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:52.228776    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp" podStartSLOduration=1.784298774 podStartE2EDuration="2.228759316s" totalImagesPullingTime="444.460542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:10:52.228462065 +0000 UTC m=+774.662292014" watchObservedRunningTime="2026-09-10 21:10:52.228759316 +0000 UTC m=+774.662589277"
Sep 10 21:10:52.311851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:52.311817    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:53.030662 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:53.030630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:10:58.223980 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:10:58.223944    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:11:01.956925 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:01.956877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:02.494108 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.494072    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"]
Sep 10 21:11:02.494338 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.494313    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8" podUID="124880d0-0ec6-46cf-b32c-e7c6ef49e2de" containerName="maas-api" containerID="cri-o://74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7" gracePeriod=30
Sep 10 21:11:02.517942 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.517914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:02.585149 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.585118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:02.646499 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.646463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:02.710868 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.710832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:02.761500 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.761471    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:11:02.770297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.770272    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:02.909298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.909256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-openshift-service-ca\") pod \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") "
Sep 10 21:11:02.909498 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.909353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-metrics-certs\") pod \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") "
Sep 10 21:11:02.909498 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.909440    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-maas-api-tls\") pod \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") "
Sep 10 21:11:02.909625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.909539    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6s5w\" (UniqueName: \"kubernetes.io/projected/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-kube-api-access-s6s5w\") pod \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\" (UID: \"124880d0-0ec6-46cf-b32c-e7c6ef49e2de\") "
Sep 10 21:11:02.909733 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.909705    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "124880d0-0ec6-46cf-b32c-e7c6ef49e2de" (UID: "124880d0-0ec6-46cf-b32c-e7c6ef49e2de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:02.909964 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.909945    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:02.911649 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.911614    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "124880d0-0ec6-46cf-b32c-e7c6ef49e2de" (UID: "124880d0-0ec6-46cf-b32c-e7c6ef49e2de"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:02.912002 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.911974    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-kube-api-access-s6s5w" (OuterVolumeSpecName: "kube-api-access-s6s5w") pod "124880d0-0ec6-46cf-b32c-e7c6ef49e2de" (UID: "124880d0-0ec6-46cf-b32c-e7c6ef49e2de"). InnerVolumeSpecName "kube-api-access-s6s5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:02.912123 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:02.912006    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "124880d0-0ec6-46cf-b32c-e7c6ef49e2de" (UID: "124880d0-0ec6-46cf-b32c-e7c6ef49e2de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:03.010922 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.010840    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:03.010922 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.010869    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:03.010922 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.010880    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6s5w\" (UniqueName: \"kubernetes.io/projected/124880d0-0ec6-46cf-b32c-e7c6ef49e2de-kube-api-access-s6s5w\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:03.041702 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.041668    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:03.279611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.279522    2573 generic.go:356] "Generic (PLEG): container finished" podID="124880d0-0ec6-46cf-b32c-e7c6ef49e2de" containerID="74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7" exitCode=0
Sep 10 21:11:03.279611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.279565    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"
Sep 10 21:11:03.279790 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.279609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8" event={"ID":"124880d0-0ec6-46cf-b32c-e7c6ef49e2de","Type":"ContainerDied","Data":"74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7"}
Sep 10 21:11:03.279790 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.279668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8" event={"ID":"124880d0-0ec6-46cf-b32c-e7c6ef49e2de","Type":"ContainerDied","Data":"6ef3b8444e1f95334254e118e993c9dbda63b33ee25d4b53121c87c0ec52ff07"}
Sep 10 21:11:03.279790 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.279696    2573 scope.go:117] "RemoveContainer" containerID="74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7"
Sep 10 21:11:03.290219 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.290201    2573 scope.go:117] "RemoveContainer" containerID="74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7"
Sep 10 21:11:03.290535 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:11:03.290514    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7\": container with ID starting with 74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7 not found: ID does not exist" containerID="74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7"
Sep 10 21:11:03.290597 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.290545    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7"} err="failed to get container status \"74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7\": rpc error: code = NotFound desc = could not find container \"74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7\": container with ID starting with 74f098e98be771a6edbb6ad6fba414e2115b5493a3a2adab79873e20fa5e67e7 not found: ID does not exist"
Sep 10 21:11:03.301892 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.301864    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"]
Sep 10 21:11:03.305044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:03.305017    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-94604f-644b878b77-ppwv8"]
Sep 10 21:11:04.044072 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:04.044037    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124880d0-0ec6-46cf-b32c-e7c6ef49e2de" path="/var/lib/kubelet/pods/124880d0-0ec6-46cf-b32c-e7c6ef49e2de/volumes"
Sep 10 21:11:09.046112 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.046077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:09.109006 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.108968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:09.294703 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.294669    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:09.692042 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.692006    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:09.944340 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.944247    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"]
Sep 10 21:11:09.944995 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.944970    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124880d0-0ec6-46cf-b32c-e7c6ef49e2de" containerName="maas-api"
Sep 10 21:11:09.944995 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.944996    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="124880d0-0ec6-46cf-b32c-e7c6ef49e2de" containerName="maas-api"
Sep 10 21:11:09.945143 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.945129    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="124880d0-0ec6-46cf-b32c-e7c6ef49e2de" containerName="maas-api"
Sep 10 21:11:09.949251 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.949229    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:09.951660 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.951632    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-50ba47-openshift-default-dockercfg-6fx2l\""
Sep 10 21:11:09.958017 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.957964    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"]
Sep 10 21:11:09.978965 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:09.978931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:10.085876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.085830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-credential-socket\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.085975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-certs\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086028    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34873943-881c-4954-aa31-e193cdc0194a-istio-podinfo\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-socket\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-data\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-istio-token\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34873943-881c-4954-aa31-e193cdc0194a-istiod-ca-cert\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086260    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-envoy\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.086618 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.086364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k672b\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-kube-api-access-k672b\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.147814 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.147782    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:10.187665 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-socket\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.187879 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-data\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.187879 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-istio-token\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.187879 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34873943-881c-4954-aa31-e193cdc0194a-istiod-ca-cert\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.187879 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-envoy\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.187879 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k672b\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-kube-api-access-k672b\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.187879 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-credential-socket\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188230 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.187953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-certs\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188230 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.188010    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34873943-881c-4954-aa31-e193cdc0194a-istio-podinfo\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188230 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.188153    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-socket\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188434 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.188254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-credential-socket\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.188531    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-data\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188637 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.188555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34873943-881c-4954-aa31-e193cdc0194a-istiod-ca-cert\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.188637 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.188568    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-certs\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.190486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.190453    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-envoy\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.190639 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.190623    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34873943-881c-4954-aa31-e193cdc0194a-istio-podinfo\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.196036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.195972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-istio-token\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.196538 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.196519    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k672b\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-kube-api-access-k672b\") pod \"e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") " pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.264018 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.263979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:10.542925 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.542897    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"]
Sep 10 21:11:10.545117 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:11:10.545072    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34873943_881c_4954_aa31_e193cdc0194a.slice/crio-805ed3bb7755cce9b8a0453539a2e02e2fa459d66bdf102460e243d6b1082d9f WatchSource:0}: Error finding container 805ed3bb7755cce9b8a0453539a2e02e2fa459d66bdf102460e243d6b1082d9f: Status 404 returned error can't find the container with id 805ed3bb7755cce9b8a0453539a2e02e2fa459d66bdf102460e243d6b1082d9f
Sep 10 21:11:10.547647 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.547612    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:11:10.547775 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.547699    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:11:10.547775 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:10.547743    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:11:11.337897 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:11.337860    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" event={"ID":"34873943-881c-4954-aa31-e193cdc0194a","Type":"ContainerStarted","Data":"cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"}
Sep 10 21:11:11.338283 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:11.337914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" event={"ID":"34873943-881c-4954-aa31-e193cdc0194a","Type":"ContainerStarted","Data":"805ed3bb7755cce9b8a0453539a2e02e2fa459d66bdf102460e243d6b1082d9f"}
Sep 10 21:11:11.358838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:11.358783    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podStartSLOduration=2.358764095 podStartE2EDuration="2.358764095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:11.356556082 +0000 UTC m=+793.790386033" watchObservedRunningTime="2026-09-10 21:11:11.358764095 +0000 UTC m=+793.792594118"
Sep 10 21:11:12.089338 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:12.089293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:12.264747 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:12.264708    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:12.270175 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:12.270148    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:12.343342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:12.343251    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:12.344120 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:12.344095    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:13.274017 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:13.273981    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.374545 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:13.374510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:13.473836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:13.473804    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:14.489976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.489930    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"]
Sep 10 21:11:14.494968 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.494935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.497761 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.497732    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-50ba47-serving-cert\""
Sep 10 21:11:14.510956 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.510372    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"]
Sep 10 21:11:14.530268 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.530226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:14.621759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.621724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:14.635420 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.635372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8xh\" (UniqueName: \"kubernetes.io/projected/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-kube-api-access-mh8xh\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.635631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.635475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-maas-api-tls\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.635631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.635516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-metrics-certs\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.635631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.635594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-openshift-service-ca\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.721889 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.721850    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:14.736775 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.736729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-metrics-certs\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.736971 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.736840    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-openshift-service-ca\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.737027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.736999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8xh\" (UniqueName: \"kubernetes.io/projected/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-kube-api-access-mh8xh\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.737080 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.737055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-maas-api-tls\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.737796 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.737764    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-openshift-service-ca\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.739720 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.739692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-metrics-certs\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.740019 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.739967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-maas-api-tls\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.745000 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.744965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8xh\" (UniqueName: \"kubernetes.io/projected/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-kube-api-access-mh8xh\") pod \"maas-api-e2e-explicit-50ba47-844dc46878-wx7xb\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:14.812968 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:14.812923    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:15.001499 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:15.001409    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:15.095996 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:15.095968    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"]
Sep 10 21:11:15.097278 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:15.097247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:15.098733 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:11:15.098709    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11dcd84f_9ca5_48f6_8e7d_3143b4e29b45.slice/crio-da99ae3a9da45a245a4b4e1be2a8466bf782a58126c30a8a7fdd64e31c2fd4b4 WatchSource:0}: Error finding container da99ae3a9da45a245a4b4e1be2a8466bf782a58126c30a8a7fdd64e31c2fd4b4: Status 404 returned error can't find the container with id da99ae3a9da45a245a4b4e1be2a8466bf782a58126c30a8a7fdd64e31c2fd4b4
Sep 10 21:11:15.362258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:15.362219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb" event={"ID":"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45","Type":"ContainerStarted","Data":"da99ae3a9da45a245a4b4e1be2a8466bf782a58126c30a8a7fdd64e31c2fd4b4"}
Sep 10 21:11:15.581523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:15.581494    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:16.369711 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:16.369671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb" event={"ID":"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45","Type":"ContainerStarted","Data":"faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131"}
Sep 10 21:11:16.369935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:16.369754    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:16.387204 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:16.386908    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb" podStartSLOduration=1.322532682 podStartE2EDuration="2.386886008s" totalImagesPullingTime="1.064353326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:16.385637269 +0000 UTC m=+798.819467221" watchObservedRunningTime="2026-09-10 21:11:16.386886008 +0000 UTC m=+798.820715958"
Sep 10 21:11:16.418599 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:16.418520    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:19.414894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:19.414855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:20.976368 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:20.976286    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:21.509794 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.509758    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"]
Sep 10 21:11:21.511039 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.511002    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp" podUID="d665dd98-9d3a-4647-8dba-4f3a4719fe20" containerName="maas-api" containerID="cri-o://cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8" gracePeriod=30
Sep 10 21:11:21.533622 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.533590    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:21.642755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.642707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:21.746524 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.746481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:21.784518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.784478    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:11:21.814550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.814487    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-metrics-certs\") pod \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") "
Sep 10 21:11:21.814752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.814586    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54z6s\" (UniqueName: \"kubernetes.io/projected/d665dd98-9d3a-4647-8dba-4f3a4719fe20-kube-api-access-54z6s\") pod \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") "
Sep 10 21:11:21.814752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.814626    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-maas-api-tls\") pod \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") "
Sep 10 21:11:21.814752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.814711    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d665dd98-9d3a-4647-8dba-4f3a4719fe20-openshift-service-ca\") pod \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\" (UID: \"d665dd98-9d3a-4647-8dba-4f3a4719fe20\") "
Sep 10 21:11:21.815431 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.815363    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d665dd98-9d3a-4647-8dba-4f3a4719fe20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d665dd98-9d3a-4647-8dba-4f3a4719fe20" (UID: "d665dd98-9d3a-4647-8dba-4f3a4719fe20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:21.817828 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.817795    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d665dd98-9d3a-4647-8dba-4f3a4719fe20" (UID: "d665dd98-9d3a-4647-8dba-4f3a4719fe20"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:21.817951 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.817796    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d665dd98-9d3a-4647-8dba-4f3a4719fe20-kube-api-access-54z6s" (OuterVolumeSpecName: "kube-api-access-54z6s") pod "d665dd98-9d3a-4647-8dba-4f3a4719fe20" (UID: "d665dd98-9d3a-4647-8dba-4f3a4719fe20"). InnerVolumeSpecName "kube-api-access-54z6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:21.817951 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.817897    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d665dd98-9d3a-4647-8dba-4f3a4719fe20" (UID: "d665dd98-9d3a-4647-8dba-4f3a4719fe20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:21.829954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.829929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:21.908513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.908481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:21.915819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.915788    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d665dd98-9d3a-4647-8dba-4f3a4719fe20-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:21.915819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.915817    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:21.915819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.915826    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54z6s\" (UniqueName: \"kubernetes.io/projected/d665dd98-9d3a-4647-8dba-4f3a4719fe20-kube-api-access-54z6s\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:21.916127 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:21.915836    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d665dd98-9d3a-4647-8dba-4f3a4719fe20-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:22.381142 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.381110    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:11:22.403692 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.403658    2573 generic.go:356] "Generic (PLEG): container finished" podID="d665dd98-9d3a-4647-8dba-4f3a4719fe20" containerID="cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8" exitCode=0
Sep 10 21:11:22.403894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.403717    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"
Sep 10 21:11:22.403894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.403757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp" event={"ID":"d665dd98-9d3a-4647-8dba-4f3a4719fe20","Type":"ContainerDied","Data":"cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8"}
Sep 10 21:11:22.403894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.403804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp" event={"ID":"d665dd98-9d3a-4647-8dba-4f3a4719fe20","Type":"ContainerDied","Data":"95f439d1cbb38c15869f26d9754004afba1b9e22dd125b5ef9a14693fed88a01"}
Sep 10 21:11:22.403894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.403832    2573 scope.go:117] "RemoveContainer" containerID="cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8"
Sep 10 21:11:22.417177 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.417149    2573 scope.go:117] "RemoveContainer" containerID="cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8"
Sep 10 21:11:22.417592 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:11:22.417558    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8\": container with ID starting with cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8 not found: ID does not exist" containerID="cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8"
Sep 10 21:11:22.417681 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.417601    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8"} err="failed to get container status \"cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8\": rpc error: code = NotFound desc = could not find container \"cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8\": container with ID starting with cb6008555b7516c238fc5cbbb45ff7f4f44527f33da4422b53f64e71dcabaae8 not found: ID does not exist"
Sep 10 21:11:22.423825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.423796    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"]
Sep 10 21:11:22.427510 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.427484    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1992fc41-7d9b986fd4-xshfp"]
Sep 10 21:11:22.914653 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:22.914612    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:23.336807 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:23.336772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:23.609462 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:23.609353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:23.890552 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:23.890460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:24.043650 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:24.043618    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d665dd98-9d3a-4647-8dba-4f3a4719fe20" path="/var/lib/kubelet/pods/d665dd98-9d3a-4647-8dba-4f3a4719fe20/volumes"
Sep 10 21:11:25.905791 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:25.905689    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:26.003911 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:26.003878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:27.189516 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.189481    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"]
Sep 10 21:11:27.190244 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.190221    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d665dd98-9d3a-4647-8dba-4f3a4719fe20" containerName="maas-api"
Sep 10 21:11:27.190312 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.190248    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d665dd98-9d3a-4647-8dba-4f3a4719fe20" containerName="maas-api"
Sep 10 21:11:27.190377 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.190364    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d665dd98-9d3a-4647-8dba-4f3a4719fe20" containerName="maas-api"
Sep 10 21:11:27.194544 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.194516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.197204 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.197169    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f68becc7-serving-cert\""
Sep 10 21:11:27.242601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.242546    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:27.255247 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.255194    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"]
Sep 10 21:11:27.270701 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.270666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-metrics-certs\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.270884 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.270722    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-maas-api-tls\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.270884 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.270831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9395b8-31bc-40c2-b799-902106388989-openshift-service-ca\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.271035 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.270919    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbzzg\" (UniqueName: \"kubernetes.io/projected/0b9395b8-31bc-40c2-b799-902106388989-kube-api-access-rbzzg\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.332340 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.330985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:27.372420 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.372364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-metrics-certs\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.372598 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.372520    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-maas-api-tls\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.372598 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.372559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9395b8-31bc-40c2-b799-902106388989-openshift-service-ca\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.372679 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.372626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbzzg\" (UniqueName: \"kubernetes.io/projected/0b9395b8-31bc-40c2-b799-902106388989-kube-api-access-rbzzg\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.373322 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.373294    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9395b8-31bc-40c2-b799-902106388989-openshift-service-ca\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.374905 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.374883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-maas-api-tls\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.375019 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.374906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-metrics-certs\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.380764 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.380741    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbzzg\" (UniqueName: \"kubernetes.io/projected/0b9395b8-31bc-40c2-b799-902106388989-kube-api-access-rbzzg\") pod \"maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.531282 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.531187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:27.833248 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.830969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"]
Sep 10 21:11:27.841436 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.833847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:27.934430 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:27.934359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:28.448388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:28.448352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn" event={"ID":"0b9395b8-31bc-40c2-b799-902106388989","Type":"ContainerStarted","Data":"cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb"}
Sep 10 21:11:28.448798 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:28.448448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn" event={"ID":"0b9395b8-31bc-40c2-b799-902106388989","Type":"ContainerStarted","Data":"de0ac8fb83eede6bec15f3c0fe15df3c15b0e6ea25d3ccff17d7fc7d20dde452"}
Sep 10 21:11:28.466242 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:28.466129    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn" podStartSLOduration=1.095736923 podStartE2EDuration="1.466108699s" totalImagesPullingTime="370.371776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:28.464605563 +0000 UTC m=+810.898435540" watchObservedRunningTime="2026-09-10 21:11:28.466108699 +0000 UTC m=+810.899938672"
Sep 10 21:11:29.454136 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:29.454102    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:34.489179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:34.489092    2573 generic.go:356] "Generic (PLEG): container finished" podID="34873943-881c-4954-aa31-e193cdc0194a" containerID="cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56" exitCode=0
Sep 10 21:11:34.489179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:34.489166    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" event={"ID":"34873943-881c-4954-aa31-e193cdc0194a","Type":"ContainerDied","Data":"cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"}
Sep 10 21:11:34.489678 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:34.489634    2573 scope.go:117] "RemoveContainer" containerID="cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"
Sep 10 21:11:34.490807 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:34.490775    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:11:34.490921 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:34.490851    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:11:34.490921 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:34.490882    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:11:35.441787 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:35.441748    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:35.466006 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:35.465974    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:35.500203 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:35.499894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" event={"ID":"34873943-881c-4954-aa31-e193cdc0194a","Type":"ContainerStarted","Data":"f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b"}
Sep 10 21:11:35.694541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:35.694456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:36.265222 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:36.265182    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:36.265222 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:36.265222    2573 patch_prober.go:28] interesting pod/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:36.265483 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:36.265265    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 21:11:37.265459 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:37.265421    2573 patch_prober.go:28] interesting pod/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:37.265915 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:37.265477    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 21:11:38.138219 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:38.138183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:38.265245 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:38.265204    2573 patch_prober.go:28] interesting pod/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:38.265492 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:38.265265    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 21:11:39.265281 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:39.265242    2573 patch_prober.go:28] interesting pod/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:39.265507 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:39.265300    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 21:11:40.265486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:40.265440    2573 patch_prober.go:28] interesting pod/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 10 21:11:40.265688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:40.265500    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 10 21:11:41.269348 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:41.269317    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:41.269741 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:41.269619    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:41.270384 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:41.270367    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:11:42.605952 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:42.605920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:42.654246 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:42.654215    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:46.404665 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:46.404610    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:48.279726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:48.279690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:57.571908 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.571864    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"]
Sep 10 21:11:57.572566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.572235    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn" podUID="0b9395b8-31bc-40c2-b799-902106388989" containerName="maas-api" containerID="cri-o://cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb" gracePeriod=30
Sep 10 21:11:57.600981 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.600940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:57.667225 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.667187    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:57.728106 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.728062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:57.784908 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.784854    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:57.837183 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.837154    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:57.846297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.846273    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:57.919874 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.919835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-metrics-certs\") pod \"0b9395b8-31bc-40c2-b799-902106388989\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") "
Sep 10 21:11:57.920144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.920125    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-maas-api-tls\") pod \"0b9395b8-31bc-40c2-b799-902106388989\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") "
Sep 10 21:11:57.920269 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.920254    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbzzg\" (UniqueName: \"kubernetes.io/projected/0b9395b8-31bc-40c2-b799-902106388989-kube-api-access-rbzzg\") pod \"0b9395b8-31bc-40c2-b799-902106388989\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") "
Sep 10 21:11:57.920692 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.920459    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9395b8-31bc-40c2-b799-902106388989-openshift-service-ca\") pod \"0b9395b8-31bc-40c2-b799-902106388989\" (UID: \"0b9395b8-31bc-40c2-b799-902106388989\") "
Sep 10 21:11:57.921129 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.920954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b9395b8-31bc-40c2-b799-902106388989-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b9395b8-31bc-40c2-b799-902106388989" (UID: "0b9395b8-31bc-40c2-b799-902106388989"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:57.921571 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.921550    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b9395b8-31bc-40c2-b799-902106388989-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:57.923479 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.923435    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9395b8-31bc-40c2-b799-902106388989-kube-api-access-rbzzg" (OuterVolumeSpecName: "kube-api-access-rbzzg") pod "0b9395b8-31bc-40c2-b799-902106388989" (UID: "0b9395b8-31bc-40c2-b799-902106388989"). InnerVolumeSpecName "kube-api-access-rbzzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:57.924393 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.924346    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0b9395b8-31bc-40c2-b799-902106388989" (UID: "0b9395b8-31bc-40c2-b799-902106388989"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:57.924764 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.924716    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b9395b8-31bc-40c2-b799-902106388989" (UID: "0b9395b8-31bc-40c2-b799-902106388989"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:11:57.925227 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:57.925204    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:58.024199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.024156    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.024199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.024195    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b9395b8-31bc-40c2-b799-902106388989-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.024199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.024208    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbzzg\" (UniqueName: \"kubernetes.io/projected/0b9395b8-31bc-40c2-b799-902106388989-kube-api-access-rbzzg\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:11:58.554452 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.554337    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:58.649418 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.649364    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:11:58.655103 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.655075    2573 generic.go:356] "Generic (PLEG): container finished" podID="0b9395b8-31bc-40c2-b799-902106388989" containerID="cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb" exitCode=0
Sep 10 21:11:58.655254 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.655115    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn" event={"ID":"0b9395b8-31bc-40c2-b799-902106388989","Type":"ContainerDied","Data":"cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb"}
Sep 10 21:11:58.655254 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.655134    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"
Sep 10 21:11:58.655254 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.655161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn" event={"ID":"0b9395b8-31bc-40c2-b799-902106388989","Type":"ContainerDied","Data":"de0ac8fb83eede6bec15f3c0fe15df3c15b0e6ea25d3ccff17d7fc7d20dde452"}
Sep 10 21:11:58.655254 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.655185    2573 scope.go:117] "RemoveContainer" containerID="cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb"
Sep 10 21:11:58.667016 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.666990    2573 scope.go:117] "RemoveContainer" containerID="cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb"
Sep 10 21:11:58.667334 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:11:58.667316    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb\": container with ID starting with cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb not found: ID does not exist" containerID="cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb"
Sep 10 21:11:58.667410 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.667346    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb"} err="failed to get container status \"cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb\": rpc error: code = NotFound desc = could not find container \"cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb\": container with ID starting with cfe7053bfd23d1ea10e0eefaac8a7806b3ee0ac5294ed02c01476d07194d6cfb not found: ID does not exist"
Sep 10 21:11:58.671100 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.671076    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"]
Sep 10 21:11:58.674691 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.674667    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f68becc7-69b5798d6-mzxqn"]
Sep 10 21:11:58.737891 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:11:58.737833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:00.043339 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:00.043300    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b9395b8-31bc-40c2-b799-902106388989" path="/var/lib/kubelet/pods/0b9395b8-31bc-40c2-b799-902106388989/volumes"
Sep 10 21:12:00.050942 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:00.050906    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:05.914834 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:05.914783    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:06.016137 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:06.016103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:06.115070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:06.115035    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:06.215565 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:06.215475    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:06.450023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:06.449980    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:06.572650 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:06.572617    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:09.765910 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:09.765871    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:27.190766 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:27.190735    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:32.518726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:32.518685    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:38.407775 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:38.407722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:38.513587 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:38.513548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:38.607888 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:38.607852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:50.934223 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:50.934103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:51.105954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:51.105914    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:54.414660 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:54.414621    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:12:58.055416 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:58.055381    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:12:58.056707 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:12:58.056687    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:13:00.198201 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:00.198146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:00.301831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:00.301796    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:00.397823 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:00.397789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:01.455640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.455609    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"]
Sep 10 21:13:01.456108 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.455855    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb" podUID="11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" containerName="maas-api" containerID="cri-o://faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131" gracePeriod=30
Sep 10 21:13:01.467023 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.466966    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:01.538601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.538565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:01.599970 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.599935    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:01.658297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.658267    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:01.717555 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.717510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:01.727966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.727940    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:13:01.826657 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.826622    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh8xh\" (UniqueName: \"kubernetes.io/projected/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-kube-api-access-mh8xh\") pod \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") "
Sep 10 21:13:01.826844 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.826771    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-maas-api-tls\") pod \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") "
Sep 10 21:13:01.826844 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.826802    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-metrics-certs\") pod \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") "
Sep 10 21:13:01.826918 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.826843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-openshift-service-ca\") pod \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\" (UID: \"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45\") "
Sep 10 21:13:01.827270 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.827236    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" (UID: "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:01.828819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.828789    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-kube-api-access-mh8xh" (OuterVolumeSpecName: "kube-api-access-mh8xh") pod "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" (UID: "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45"). InnerVolumeSpecName "kube-api-access-mh8xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:01.828956 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.828933    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" (UID: "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:01.829002 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.828952    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" (UID: "11dcd84f-9ca5-48f6-8e7d-3143b4e29b45"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:01.928533 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.928491    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:01.928533 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.928525    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:01.928533 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.928541    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:01.928785 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:01.928556    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh8xh\" (UniqueName: \"kubernetes.io/projected/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45-kube-api-access-mh8xh\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:02.008658 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.008567    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:02.022440 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.022393    2573 generic.go:356] "Generic (PLEG): container finished" podID="11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" containerID="faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131" exitCode=0
Sep 10 21:13:02.022440 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.022430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb" event={"ID":"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45","Type":"ContainerDied","Data":"faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131"}
Sep 10 21:13:02.022688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.022451    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"
Sep 10 21:13:02.022688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.022497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb" event={"ID":"11dcd84f-9ca5-48f6-8e7d-3143b4e29b45","Type":"ContainerDied","Data":"da99ae3a9da45a245a4b4e1be2a8466bf782a58126c30a8a7fdd64e31c2fd4b4"}
Sep 10 21:13:02.022688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.022528    2573 scope.go:117] "RemoveContainer" containerID="faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131"
Sep 10 21:13:02.033377 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.033357    2573 scope.go:117] "RemoveContainer" containerID="faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131"
Sep 10 21:13:02.033767 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:13:02.033738    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131\": container with ID starting with faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131 not found: ID does not exist" containerID="faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131"
Sep 10 21:13:02.033844 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.033777    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131"} err="failed to get container status \"faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131\": rpc error: code = NotFound desc = could not find container \"faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131\": container with ID starting with faddfdf5f9957a0d103de89f899c1179866aeadbc139d9a8c007a4b6881e2131 not found: ID does not exist"
Sep 10 21:13:02.043910 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.043880    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"]
Sep 10 21:13:02.046984 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:02.046956    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-50ba47-844dc46878-wx7xb"]
Sep 10 21:13:04.044026 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:04.043988    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" path="/var/lib/kubelet/pods/11dcd84f-9ca5-48f6-8e7d-3143b4e29b45/volumes"
Sep 10 21:13:07.091572 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:07.091533    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:08.152130 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:08.152098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:08.253245 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:08.253198    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:08.372852 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:08.372819    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"]
Sep 10 21:13:08.373130 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:08.373100    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" containerID="cri-o://f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b" gracePeriod=30
Sep 10 21:13:08.395502 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:08.395471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:08.870424 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:08.870370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:09.123173 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:09.123095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:09.895029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:09.894993    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:10.433541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:10.433509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:10.533496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:10.533460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:10.631954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:10.631923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:10.863377 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:10.863341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:11.272264 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:11.272175    2573 patch_prober.go:28] interesting pod/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:13:11.272710 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:11.272258    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:13:11.613783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:11.613746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:13.642985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.642919    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:13:13.756302 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756264    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-socket\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756302 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756308    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34873943-881c-4954-aa31-e193cdc0194a-istio-podinfo\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756333    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-data\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756364    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-credential-socket\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756422    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k672b\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-kube-api-access-k672b\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756457    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-istio-token\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756498    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-envoy\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756526    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34873943-881c-4954-aa31-e193cdc0194a-istiod-ca-cert\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756577    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-certs\") pod \"34873943-881c-4954-aa31-e193cdc0194a\" (UID: \"34873943-881c-4954-aa31-e193cdc0194a\") "
Sep 10 21:13:13.756966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756668    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-data" (OuterVolumeSpecName: "istio-data") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:13.756966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756660    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:13.756966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756858    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:13.756966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756873    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:13.757172 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.756970    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34873943-881c-4954-aa31-e193cdc0194a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:13.757172 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.757033    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.757172 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.757050    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.757172 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.757063    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.757172 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.757078    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.758639 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.758610    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34873943-881c-4954-aa31-e193cdc0194a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:13.758876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.758854    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-istio-token" (OuterVolumeSpecName: "istio-token") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:13.759154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.759130    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:13.759227 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.759154    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-kube-api-access-k672b" (OuterVolumeSpecName: "kube-api-access-k672b") pod "34873943-881c-4954-aa31-e193cdc0194a" (UID: "34873943-881c-4954-aa31-e193cdc0194a"). InnerVolumeSpecName "kube-api-access-k672b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:13.858695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.858651    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.858695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.858687    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34873943-881c-4954-aa31-e193cdc0194a-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.858695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.858700    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34873943-881c-4954-aa31-e193cdc0194a-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.858935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.858710    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34873943-881c-4954-aa31-e193cdc0194a-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:13.858935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:13.858722    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k672b\" (UniqueName: \"kubernetes.io/projected/34873943-881c-4954-aa31-e193cdc0194a-kube-api-access-k672b\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:14.092669 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.092632    2573 generic.go:356] "Generic (PLEG): container finished" podID="34873943-881c-4954-aa31-e193cdc0194a" containerID="f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b" exitCode=0
Sep 10 21:13:14.092833 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.092697    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"
Sep 10 21:13:14.092833 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.092713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" event={"ID":"34873943-881c-4954-aa31-e193cdc0194a","Type":"ContainerDied","Data":"f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b"}
Sep 10 21:13:14.092833 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.092796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz" event={"ID":"34873943-881c-4954-aa31-e193cdc0194a","Type":"ContainerDied","Data":"805ed3bb7755cce9b8a0453539a2e02e2fa459d66bdf102460e243d6b1082d9f"}
Sep 10 21:13:14.092833 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.092820    2573 scope.go:117] "RemoveContainer" containerID="f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b"
Sep 10 21:13:14.101839 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.101819    2573 scope.go:117] "RemoveContainer" containerID="cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"
Sep 10 21:13:14.110991 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.110957    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"]
Sep 10 21:13:14.111923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.111906    2573 scope.go:117] "RemoveContainer" containerID="f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b"
Sep 10 21:13:14.112287 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:13:14.112267    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b\": container with ID starting with f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b not found: ID does not exist" containerID="f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b"
Sep 10 21:13:14.112340 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.112298    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b"} err="failed to get container status \"f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b\": rpc error: code = NotFound desc = could not find container \"f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b\": container with ID starting with f6b1e4aa6a35bbfab0392ecf782200a94a61471d0d8852708be96f35a89a462b not found: ID does not exist"
Sep 10 21:13:14.112340 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.112318    2573 scope.go:117] "RemoveContainer" containerID="cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"
Sep 10 21:13:14.112618 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:13:14.112600    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56\": container with ID starting with cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56 not found: ID does not exist" containerID="cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"
Sep 10 21:13:14.112671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.112627    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56"} err="failed to get container status \"cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56\": rpc error: code = NotFound desc = could not find container \"cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56\": container with ID starting with cd3930561b6631e717a00e7f41572b2588f0c75cad800fde0bab012162a20c56 not found: ID does not exist"
Sep 10 21:13:14.113144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:14.113127    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz"]
Sep 10 21:13:16.043536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:16.043505    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34873943-881c-4954-aa31-e193cdc0194a" path="/var/lib/kubelet/pods/34873943-881c-4954-aa31-e193cdc0194a/volumes"
Sep 10 21:13:17.449962 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:17.449933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:17.505938 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:17.505893    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:17.581958 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:17.581926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:17.682230 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:17.682200    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:17.782812 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:17.782722    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:18.339953 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:18.339925    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:18.439848 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:18.439812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:18.593609 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:18.593510    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:19.931302 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:19.931265    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:20.401945 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:20.401907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:22.480518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:22.480484    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:22.597100 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:22.597072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:22.808114 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:22.808015    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:23.022556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:23.022524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:25.765669 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:25.765633    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:25.823358 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:25.823327    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:26.416440 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:26.416390    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:28.001859 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:28.001824    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.048583 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:32.048548    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.108504 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:32.108471    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.290895 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:32.290862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.558446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:32.558386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:32.832326 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:32.832288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:35.187550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:35.187473    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:35.287308 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:35.287269    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.295045 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295010    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"]
Sep 10 21:13:36.295742 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295719    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" containerName="maas-api"
Sep 10 21:13:36.295831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295746    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" containerName="maas-api"
Sep 10 21:13:36.295831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295788    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy"
Sep 10 21:13:36.295831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295800    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy"
Sep 10 21:13:36.295831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295810    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9395b8-31bc-40c2-b799-902106388989" containerName="maas-api"
Sep 10 21:13:36.295831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295819    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9395b8-31bc-40c2-b799-902106388989" containerName="maas-api"
Sep 10 21:13:36.296029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295844    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy"
Sep 10 21:13:36.296029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.295853    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy"
Sep 10 21:13:36.296029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.296011    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy"
Sep 10 21:13:36.296260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.296033    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="11dcd84f-9ca5-48f6-8e7d-3143b4e29b45" containerName="maas-api"
Sep 10 21:13:36.296260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.296045    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="34873943-881c-4954-aa31-e193cdc0194a" containerName="istio-proxy"
Sep 10 21:13:36.296260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.296058    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9395b8-31bc-40c2-b799-902106388989" containerName="maas-api"
Sep 10 21:13:36.299458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.299434    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.302089 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.302066    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-766d8c20-serving-cert\""
Sep 10 21:13:36.312693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.312660    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"]
Sep 10 21:13:36.328270 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.328241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.392866 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.392834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmz8t\" (UniqueName: \"kubernetes.io/projected/e0eb343c-998a-4d1e-b363-1a5b131193cf-kube-api-access-nmz8t\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.393056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.392901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-metrics-certs\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.393132 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.393054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-maas-api-tls\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.393189 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.393158    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0eb343c-998a-4d1e-b363-1a5b131193cf-openshift-service-ca\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.427380 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.427345    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.494307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.494264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-metrics-certs\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.494529 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.494367    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-maas-api-tls\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.494529 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.494470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0eb343c-998a-4d1e-b363-1a5b131193cf-openshift-service-ca\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.494529 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.494522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmz8t\" (UniqueName: \"kubernetes.io/projected/e0eb343c-998a-4d1e-b363-1a5b131193cf-kube-api-access-nmz8t\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.495124 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.495098    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0eb343c-998a-4d1e-b363-1a5b131193cf-openshift-service-ca\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.496927 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.496909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-metrics-certs\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.496927 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.496924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-maas-api-tls\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.502217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.502194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmz8t\" (UniqueName: \"kubernetes.io/projected/e0eb343c-998a-4d1e-b363-1a5b131193cf-kube-api-access-nmz8t\") pod \"maas-api-e2e-mt-766d8c20-85db64d68d-8z678\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.527149 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.527113    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.615355 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.615322    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:36.800869 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.800831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.889328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.889296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:36.890364 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:36.890337    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"]
Sep 10 21:13:36.891807 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:13:36.891784    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0eb343c_998a_4d1e_b363_1a5b131193cf.slice/crio-282bf23b381ec03d5d370dce94da86be7f6f3c866e93d71ef791ab0c16284ea8 WatchSource:0}: Error finding container 282bf23b381ec03d5d370dce94da86be7f6f3c866e93d71ef791ab0c16284ea8: Status 404 returned error can't find the container with id 282bf23b381ec03d5d370dce94da86be7f6f3c866e93d71ef791ab0c16284ea8
Sep 10 21:13:37.225753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:37.225665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678" event={"ID":"e0eb343c-998a-4d1e-b363-1a5b131193cf","Type":"ContainerStarted","Data":"282bf23b381ec03d5d370dce94da86be7f6f3c866e93d71ef791ab0c16284ea8"}
Sep 10 21:13:38.233630 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:38.233595    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678" event={"ID":"e0eb343c-998a-4d1e-b363-1a5b131193cf","Type":"ContainerStarted","Data":"847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589"}
Sep 10 21:13:38.234125 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:38.233727    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:38.253704 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:38.253653    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678" podStartSLOduration=1.825988741 podStartE2EDuration="2.253637408s" totalImagesPullingTime="427.648667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:38.25043694 +0000 UTC m=+940.684266886" watchObservedRunningTime="2026-09-10 21:13:38.253637408 +0000 UTC m=+940.687467358"
Sep 10 21:13:44.246302 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:44.246271    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:13:45.527018 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:45.526982    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:47.615817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:47.615774    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:47.854924 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:47.854888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:57.183048 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:57.183014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:58.095514 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.095479    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"]
Sep 10 21:13:58.096013 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.095970    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw" podUID="e8ee9d70-0c52-49fc-832c-97004c805a0f" containerName="maas-api" containerID="cri-o://78b767ed643ec6d75163c74bb1f78f9d1d144f813144a6a52d87de8f2fef6a9e" gracePeriod=30
Sep 10 21:13:58.354169 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.354069    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8ee9d70-0c52-49fc-832c-97004c805a0f" containerID="78b767ed643ec6d75163c74bb1f78f9d1d144f813144a6a52d87de8f2fef6a9e" exitCode=0
Sep 10 21:13:58.354664 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.354264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw" event={"ID":"e8ee9d70-0c52-49fc-832c-97004c805a0f","Type":"ContainerDied","Data":"78b767ed643ec6d75163c74bb1f78f9d1d144f813144a6a52d87de8f2fef6a9e"}
Sep 10 21:13:58.391315 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.391287    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:13:58.431346 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.431311    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-metrics-certs\") pod \"e8ee9d70-0c52-49fc-832c-97004c805a0f\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") "
Sep 10 21:13:58.431346 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.431352    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ee9d70-0c52-49fc-832c-97004c805a0f-openshift-service-ca\") pod \"e8ee9d70-0c52-49fc-832c-97004c805a0f\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") "
Sep 10 21:13:58.431586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.431430    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mzkz\" (UniqueName: \"kubernetes.io/projected/e8ee9d70-0c52-49fc-832c-97004c805a0f-kube-api-access-9mzkz\") pod \"e8ee9d70-0c52-49fc-832c-97004c805a0f\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") "
Sep 10 21:13:58.431586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.431468    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-maas-api-tls\") pod \"e8ee9d70-0c52-49fc-832c-97004c805a0f\" (UID: \"e8ee9d70-0c52-49fc-832c-97004c805a0f\") "
Sep 10 21:13:58.431872 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.431826    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ee9d70-0c52-49fc-832c-97004c805a0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8ee9d70-0c52-49fc-832c-97004c805a0f" (UID: "e8ee9d70-0c52-49fc-832c-97004c805a0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:58.433603 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.433574    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e8ee9d70-0c52-49fc-832c-97004c805a0f" (UID: "e8ee9d70-0c52-49fc-832c-97004c805a0f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:58.434163 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.434131    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ee9d70-0c52-49fc-832c-97004c805a0f-kube-api-access-9mzkz" (OuterVolumeSpecName: "kube-api-access-9mzkz") pod "e8ee9d70-0c52-49fc-832c-97004c805a0f" (UID: "e8ee9d70-0c52-49fc-832c-97004c805a0f"). InnerVolumeSpecName "kube-api-access-9mzkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:58.434244 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.434155    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8ee9d70-0c52-49fc-832c-97004c805a0f" (UID: "e8ee9d70-0c52-49fc-832c-97004c805a0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:58.533213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.533171    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:58.533213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.533205    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ee9d70-0c52-49fc-832c-97004c805a0f-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:58.533213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.533216    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mzkz\" (UniqueName: \"kubernetes.io/projected/e8ee9d70-0c52-49fc-832c-97004c805a0f-kube-api-access-9mzkz\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:58.533213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.533225    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ee9d70-0c52-49fc-832c-97004c805a0f-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:13:58.832357 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:58.832323    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:13:59.360874 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:59.360843    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"
Sep 10 21:13:59.361321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:59.360881    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw" event={"ID":"e8ee9d70-0c52-49fc-832c-97004c805a0f","Type":"ContainerDied","Data":"3f21713a4636ef3e0f01e3d9919e1a4abf920272e28832edc4d2d3b98eedcca6"}
Sep 10 21:13:59.361321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:59.360943    2573 scope.go:117] "RemoveContainer" containerID="78b767ed643ec6d75163c74bb1f78f9d1d144f813144a6a52d87de8f2fef6a9e"
Sep 10 21:13:59.409446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:59.409412    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"]
Sep 10 21:13:59.413014 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:13:59.412975    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a41a24-6764d8dd59-qtbsw"]
Sep 10 21:14:00.044258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:00.044225    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ee9d70-0c52-49fc-832c-97004c805a0f" path="/var/lib/kubelet/pods/e8ee9d70-0c52-49fc-832c-97004c805a0f/volumes"
Sep 10 21:14:00.097003 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:00.096973    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:00.703945 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:00.703912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:00.781184 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:00.781150    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:01.107566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:01.107537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:04.962757 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:04.962719    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:05.062786 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:05.062752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:05.187496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:05.187454    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"]
Sep 10 21:14:05.187793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:05.187764    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy" containerID="cri-o://00ce9f8e8fd09199ea8ecd6ad4f5d942abbef76d1575a9f53e0d76a03879ce61" gracePeriod=30
Sep 10 21:14:05.216671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:05.216575    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:05.331468 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:05.331435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:05.766345 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:05.766311    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:07.131812 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:07.131781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:07.202055 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:07.202021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:07.673773 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:07.673739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:10.425807 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.425776    2573 generic.go:356] "Generic (PLEG): container finished" podID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerID="00ce9f8e8fd09199ea8ecd6ad4f5d942abbef76d1575a9f53e0d76a03879ce61" exitCode=0
Sep 10 21:14:10.426232 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.425854    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" event={"ID":"6107ffad-ce1a-42a3-98a6-8b0fceae26d2","Type":"ContainerDied","Data":"00ce9f8e8fd09199ea8ecd6ad4f5d942abbef76d1575a9f53e0d76a03879ce61"}
Sep 10 21:14:10.426232 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.425921    2573 scope.go:117] "RemoveContainer" containerID="20adc5e79a38f060b08b7c1ad5b7e1ceb88090720690eab69942c95b7a153e17"
Sep 10 21:14:10.464040 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.463952    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:14:10.558241 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558203    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-credential-socket\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5lb9\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-kube-api-access-r5lb9\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558280    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-envoy\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-data\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558355    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-socket\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558390    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-token\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558455    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istiod-ca-cert\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558526    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-podinfo\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558588    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-certs\") pod \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\" (UID: \"6107ffad-ce1a-42a3-98a6-8b0fceae26d2\") "
Sep 10 21:14:10.558783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558634    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:10.558783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558752    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:10.559012 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558865    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:10.559012 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.558956    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:10.559131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.559080    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.559131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.559102    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.559131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.559116    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.559131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.559129    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.559337 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.559254    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:10.560712 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.560672    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:10.560836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.560723    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-kube-api-access-r5lb9" (OuterVolumeSpecName: "kube-api-access-r5lb9") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "kube-api-access-r5lb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:10.560836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.560724    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:14:10.560836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.560765    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6107ffad-ce1a-42a3-98a6-8b0fceae26d2" (UID: "6107ffad-ce1a-42a3-98a6-8b0fceae26d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:10.660697 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.660654    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.660697 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.660688    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.660697 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.660697    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.660697 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.660706    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5lb9\" (UniqueName: \"kubernetes.io/projected/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-kube-api-access-r5lb9\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:10.660982 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:10.660716    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6107ffad-ce1a-42a3-98a6-8b0fceae26d2-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:11.433430 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:11.433380    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"
Sep 10 21:14:11.433869 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:11.433434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj" event={"ID":"6107ffad-ce1a-42a3-98a6-8b0fceae26d2","Type":"ContainerDied","Data":"ce89cf9f3d5656b28b61237e0d027639c815a479de70b474666593120992ad17"}
Sep 10 21:14:11.433869 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:11.433490    2573 scope.go:117] "RemoveContainer" containerID="00ce9f8e8fd09199ea8ecd6ad4f5d942abbef76d1575a9f53e0d76a03879ce61"
Sep 10 21:14:11.455739 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:11.455708    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"]
Sep 10 21:14:11.461179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:11.461154    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj"]
Sep 10 21:14:12.043777 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:12.043741    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" path="/var/lib/kubelet/pods/6107ffad-ce1a-42a3-98a6-8b0fceae26d2/volumes"
Sep 10 21:14:15.785027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:15.784992    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:16.296689 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.296650    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"]
Sep 10 21:14:16.297087 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.297026    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" podUID="cea27791-2254-4ba8-be60-61e03cac81ef" containerName="maas-api" containerID="cri-o://943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a" gracePeriod=30
Sep 10 21:14:16.330205 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.330171    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:16.423071 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.423032    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:16.515355 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.515322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:16.578144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.578114    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:16.764634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.764602    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:14:16.864604 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.864518    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:16.925005 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.924961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea27791-2254-4ba8-be60-61e03cac81ef-openshift-service-ca\") pod \"cea27791-2254-4ba8-be60-61e03cac81ef\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") "
Sep 10 21:14:16.925005 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.925014    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-metrics-certs\") pod \"cea27791-2254-4ba8-be60-61e03cac81ef\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") "
Sep 10 21:14:16.925231 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.925032    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls\") pod \"cea27791-2254-4ba8-be60-61e03cac81ef\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") "
Sep 10 21:14:16.925231 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.925080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f52kc\" (UniqueName: \"kubernetes.io/projected/cea27791-2254-4ba8-be60-61e03cac81ef-kube-api-access-f52kc\") pod \"cea27791-2254-4ba8-be60-61e03cac81ef\" (UID: \"cea27791-2254-4ba8-be60-61e03cac81ef\") "
Sep 10 21:14:16.925569 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.925532    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cea27791-2254-4ba8-be60-61e03cac81ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cea27791-2254-4ba8-be60-61e03cac81ef" (UID: "cea27791-2254-4ba8-be60-61e03cac81ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:16.927357 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.927326    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cea27791-2254-4ba8-be60-61e03cac81ef" (UID: "cea27791-2254-4ba8-be60-61e03cac81ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:16.927470 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.927348    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cea27791-2254-4ba8-be60-61e03cac81ef" (UID: "cea27791-2254-4ba8-be60-61e03cac81ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:16.927470 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:16.927362    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea27791-2254-4ba8-be60-61e03cac81ef-kube-api-access-f52kc" (OuterVolumeSpecName: "kube-api-access-f52kc") pod "cea27791-2254-4ba8-be60-61e03cac81ef" (UID: "cea27791-2254-4ba8-be60-61e03cac81ef"). InnerVolumeSpecName "kube-api-access-f52kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:17.026299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.026256    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea27791-2254-4ba8-be60-61e03cac81ef-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:17.026299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.026291    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:17.026299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.026304    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea27791-2254-4ba8-be60-61e03cac81ef-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:17.026600 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.026316    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f52kc\" (UniqueName: \"kubernetes.io/projected/cea27791-2254-4ba8-be60-61e03cac81ef-kube-api-access-f52kc\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:17.469733 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.469700    2573 generic.go:356] "Generic (PLEG): container finished" podID="cea27791-2254-4ba8-be60-61e03cac81ef" containerID="943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a" exitCode=0
Sep 10 21:14:17.469926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.469773    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"
Sep 10 21:14:17.469926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.469769    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" event={"ID":"cea27791-2254-4ba8-be60-61e03cac81ef","Type":"ContainerDied","Data":"943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a"}
Sep 10 21:14:17.469926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.469842    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t" event={"ID":"cea27791-2254-4ba8-be60-61e03cac81ef","Type":"ContainerDied","Data":"fd8faad28c54fbbff9f53e176b84b19b7756ffbf76f413551d4772910f455249"}
Sep 10 21:14:17.469926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.469867    2573 scope.go:117] "RemoveContainer" containerID="943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a"
Sep 10 21:14:17.479732 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.479705    2573 scope.go:117] "RemoveContainer" containerID="943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a"
Sep 10 21:14:17.480088 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:17.480054    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a\": container with ID starting with 943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a not found: ID does not exist" containerID="943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a"
Sep 10 21:14:17.480185 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.480092    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a"} err="failed to get container status \"943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a\": rpc error: code = NotFound desc = could not find container \"943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a\": container with ID starting with 943fc8fb3851a91bfab4974994f647dbae6692b3cd9c9b051e8e16aa15d60b3a not found: ID does not exist"
Sep 10 21:14:17.508937 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.508905    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"]
Sep 10 21:14:17.533497 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.533466    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-69dcc8-6df47fdd64-6649t"]
Sep 10 21:14:17.692298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:17.692264    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:18.043793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.043757    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cea27791-2254-4ba8-be60-61e03cac81ef" path="/var/lib/kubelet/pods/cea27791-2254-4ba8-be60-61e03cac81ef/volumes"
Sep 10 21:14:18.214654 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.211868    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"]
Sep 10 21:14:18.214654 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.212254    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678" podUID="e0eb343c-998a-4d1e-b363-1a5b131193cf" containerName="maas-api" containerID="cri-o://847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589" gracePeriod=30
Sep 10 21:14:18.240578 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.240547    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:18.309811 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.309672    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:18.410639 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.410607    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:18.472917 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.472891    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:14:18.476178 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.476148    2573 generic.go:356] "Generic (PLEG): container finished" podID="e0eb343c-998a-4d1e-b363-1a5b131193cf" containerID="847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589" exitCode=0
Sep 10 21:14:18.476326 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.476187    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"
Sep 10 21:14:18.476326 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.476216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678" event={"ID":"e0eb343c-998a-4d1e-b363-1a5b131193cf","Type":"ContainerDied","Data":"847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589"}
Sep 10 21:14:18.476326 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.476270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678" event={"ID":"e0eb343c-998a-4d1e-b363-1a5b131193cf","Type":"ContainerDied","Data":"282bf23b381ec03d5d370dce94da86be7f6f3c866e93d71ef791ab0c16284ea8"}
Sep 10 21:14:18.476326 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.476304    2573 scope.go:117] "RemoveContainer" containerID="847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589"
Sep 10 21:14:18.488587 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.488564    2573 scope.go:117] "RemoveContainer" containerID="847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589"
Sep 10 21:14:18.488946 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:18.488927    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589\": container with ID starting with 847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589 not found: ID does not exist" containerID="847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589"
Sep 10 21:14:18.489033 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.488955    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589"} err="failed to get container status \"847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589\": rpc error: code = NotFound desc = could not find container \"847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589\": container with ID starting with 847b3376e2ed71a3409ff37fe89875e6a4c01c55075366fabcfd29402353b589 not found: ID does not exist"
Sep 10 21:14:18.496579 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.496537    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:18.642877 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.642838    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0eb343c-998a-4d1e-b363-1a5b131193cf-openshift-service-ca\") pod \"e0eb343c-998a-4d1e-b363-1a5b131193cf\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") "
Sep 10 21:14:18.643076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.642906    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-maas-api-tls\") pod \"e0eb343c-998a-4d1e-b363-1a5b131193cf\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") "
Sep 10 21:14:18.643076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.642935    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmz8t\" (UniqueName: \"kubernetes.io/projected/e0eb343c-998a-4d1e-b363-1a5b131193cf-kube-api-access-nmz8t\") pod \"e0eb343c-998a-4d1e-b363-1a5b131193cf\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") "
Sep 10 21:14:18.643076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.642989    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-metrics-certs\") pod \"e0eb343c-998a-4d1e-b363-1a5b131193cf\" (UID: \"e0eb343c-998a-4d1e-b363-1a5b131193cf\") "
Sep 10 21:14:18.643258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.643218    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0eb343c-998a-4d1e-b363-1a5b131193cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0eb343c-998a-4d1e-b363-1a5b131193cf" (UID: "e0eb343c-998a-4d1e-b363-1a5b131193cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:18.643320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.643307    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0eb343c-998a-4d1e-b363-1a5b131193cf-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:18.645334 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.645297    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e0eb343c-998a-4d1e-b363-1a5b131193cf" (UID: "e0eb343c-998a-4d1e-b363-1a5b131193cf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:18.645505 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.645347    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0eb343c-998a-4d1e-b363-1a5b131193cf" (UID: "e0eb343c-998a-4d1e-b363-1a5b131193cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:14:18.645505 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.645419    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0eb343c-998a-4d1e-b363-1a5b131193cf-kube-api-access-nmz8t" (OuterVolumeSpecName: "kube-api-access-nmz8t") pod "e0eb343c-998a-4d1e-b363-1a5b131193cf" (UID: "e0eb343c-998a-4d1e-b363-1a5b131193cf"). InnerVolumeSpecName "kube-api-access-nmz8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:18.744900 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.744856    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:18.744900 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.744899    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmz8t\" (UniqueName: \"kubernetes.io/projected/e0eb343c-998a-4d1e-b363-1a5b131193cf-kube-api-access-nmz8t\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:18.745131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.744915    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0eb343c-998a-4d1e-b363-1a5b131193cf-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:18.774466 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.774431    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:18.800652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.800598    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"]
Sep 10 21:14:18.811560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:18.811516    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766d8c20-85db64d68d-8z678"]
Sep 10 21:14:20.044339 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:20.044258    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0eb343c-998a-4d1e-b363-1a5b131193cf" path="/var/lib/kubelet/pods/e0eb343c-998a-4d1e-b363-1a5b131193cf/volumes"
Sep 10 21:14:22.683205 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:22.683161    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:22.747354 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:22.747293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:22.904160 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:22.904126    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"]
Sep 10 21:14:22.904531 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:22.904498    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy" containerID="cri-o://39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6" gracePeriod=30
Sep 10 21:14:22.926620 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:22.926395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:23.473655 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:23.473625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:23.785940 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:23.785849    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:23.982151 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:23.982120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:24.973918 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:24.973874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:25.038519 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:25.038477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:25.289603 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:25.289516    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:25.552338 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:25.552250    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:25.646586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:25.646550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:25.746715 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:25.746682    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:26.612504 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:26.612472    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:27.444774 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.444739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:27.871686 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.871651    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"]
Sep 10 21:14:27.872142 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872127    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy"
Sep 10 21:14:27.872190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872144    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy"
Sep 10 21:14:27.872190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872169    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cea27791-2254-4ba8-be60-61e03cac81ef" containerName="maas-api"
Sep 10 21:14:27.872190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872174    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cea27791-2254-4ba8-be60-61e03cac81ef" containerName="maas-api"
Sep 10 21:14:27.872190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872185    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ee9d70-0c52-49fc-832c-97004c805a0f" containerName="maas-api"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872192    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ee9d70-0c52-49fc-832c-97004c805a0f" containerName="maas-api"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872206    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0eb343c-998a-4d1e-b363-1a5b131193cf" containerName="maas-api"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872211    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0eb343c-998a-4d1e-b363-1a5b131193cf" containerName="maas-api"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872283    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872291    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0eb343c-998a-4d1e-b363-1a5b131193cf" containerName="maas-api"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872299    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ee9d70-0c52-49fc-832c-97004c805a0f" containerName="maas-api"
Sep 10 21:14:27.872317 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.872306    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cea27791-2254-4ba8-be60-61e03cac81ef" containerName="maas-api"
Sep 10 21:14:27.875457 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.875430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:27.877763 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.877740    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-8623b2-serving-cert\""
Sep 10 21:14:27.884541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.884512    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"]
Sep 10 21:14:27.908334 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.908293    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:27.936550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.936516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:27.936722 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.936558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:27.936722 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.936694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:27.936799 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.936763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz9n8\" (UniqueName: \"kubernetes.io/projected/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-kube-api-access-hz9n8\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:27.970808 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:27.970741    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:28.037599 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.037565    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz9n8\" (UniqueName: \"kubernetes.io/projected/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-kube-api-access-hz9n8\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.037789 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.037647    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.037789 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.037678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.037789 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.037753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.037962 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:28.037887    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-serving-cert: secret "maas-api-e2e-shared-a-w3-8623b2-serving-cert" not found
Sep 10 21:14:28.037962 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:28.037956    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls podName:3e89ab0b-94f1-43fd-9b97-8e03c8d18459 nodeName:}" failed. No retries permitted until 2026-09-10 21:14:28.53793652 +0000 UTC m=+990.971766467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls") pod "maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" (UID: "3e89ab0b-94f1-43fd-9b97-8e03c8d18459") : secret "maas-api-e2e-shared-a-w3-8623b2-serving-cert" not found
Sep 10 21:14:28.038594 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.038559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.040234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.040207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.045960 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.045936    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz9n8\" (UniqueName: \"kubernetes.io/projected/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-kube-api-access-hz9n8\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.169208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.169181    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:14:28.209708 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.209671    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:28.239967 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.239932    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-envoy\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240150 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.239983    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-podinfo\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240150 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240042    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-credential-socket\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240150 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240085    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-certs\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240150 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240114    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-socket\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240150 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240136    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istiod-ca-cert\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240165    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lhmm\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-kube-api-access-6lhmm\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240254    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-data\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240340    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-token\") pod \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\" (UID: \"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1\") "
Sep 10 21:14:28.240446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240382    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:28.240671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240469    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:28.240671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240525    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:28.240671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240609    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:28.240823 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240718    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:28.240881 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240821    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.240881 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240845    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.240881 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240860    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.240881 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.240875    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.242546 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.242513    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:28.242676 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.242571    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-kube-api-access-6lhmm" (OuterVolumeSpecName: "kube-api-access-6lhmm") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "kube-api-access-6lhmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:28.242752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.242734    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:14:28.242797 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.242738    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" (UID: "a3575cbe-ca7e-47d4-a0bd-877f4b0902b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:14:28.342104 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.342072    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.342104 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.342098    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lhmm\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-kube-api-access-6lhmm\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.342104 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.342108    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.342426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.342118    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.342426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.342127    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:14:28.366278 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.366246    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:28.460393 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.460306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:28.540283 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.540252    2573 generic.go:356] "Generic (PLEG): container finished" podID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerID="39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6" exitCode=0
Sep 10 21:14:28.540513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.540296    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"
Sep 10 21:14:28.540513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.540340    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" event={"ID":"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1","Type":"ContainerDied","Data":"39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6"}
Sep 10 21:14:28.540513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.540429    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm" event={"ID":"a3575cbe-ca7e-47d4-a0bd-877f4b0902b1","Type":"ContainerDied","Data":"0c0415fab25cfc5a17848ef075371474f8c0e0460bcd3279b9fa549f942fe298"}
Sep 10 21:14:28.540513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.540463    2573 scope.go:117] "RemoveContainer" containerID="39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6"
Sep 10 21:14:28.543666 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.543643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.546090 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.546073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:28.549540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.549522    2573 scope.go:117] "RemoveContainer" containerID="20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"
Sep 10 21:14:28.558743 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.558726    2573 scope.go:117] "RemoveContainer" containerID="39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6"
Sep 10 21:14:28.559034 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:28.559017    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6\": container with ID starting with 39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6 not found: ID does not exist" containerID="39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6"
Sep 10 21:14:28.559080 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.559043    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6"} err="failed to get container status \"39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6\": rpc error: code = NotFound desc = could not find container \"39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6\": container with ID starting with 39312c57d973265c93bc9fa0a77197ae96cfe25bb40a0d3e9b61fc5b8ef24da6 not found: ID does not exist"
Sep 10 21:14:28.559080 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.559059    2573 scope.go:117] "RemoveContainer" containerID="20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"
Sep 10 21:14:28.559312 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:28.559290    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb\": container with ID starting with 20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb not found: ID does not exist" containerID="20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"
Sep 10 21:14:28.559359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.559318    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb"} err="failed to get container status \"20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb\": rpc error: code = NotFound desc = could not find container \"20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb\": container with ID starting with 20bd11d250336f2776042d7a9f972500316fe69bb0640218dca5aa0a5bdea2bb not found: ID does not exist"
Sep 10 21:14:28.597204 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.597163    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"]
Sep 10 21:14:28.601657 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.601625    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm"]
Sep 10 21:14:28.790551 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:28.790452    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:29.064689 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:29.064665    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"]
Sep 10 21:14:29.067187 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:14:29.067162    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e89ab0b_94f1_43fd_9b97_8e03c8d18459.slice/crio-b87bc002dd98a2cec58b3fe4ff7a190e307fb413f9abfd369212eebd7a100787 WatchSource:0}: Error finding container b87bc002dd98a2cec58b3fe4ff7a190e307fb413f9abfd369212eebd7a100787: Status 404 returned error can't find the container with id b87bc002dd98a2cec58b3fe4ff7a190e307fb413f9abfd369212eebd7a100787
Sep 10 21:14:29.068730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:29.068709    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:14:29.547441 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:29.547389    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" event={"ID":"3e89ab0b-94f1-43fd-9b97-8e03c8d18459","Type":"ContainerStarted","Data":"72691321f3f6dfe4b9a1cc444cd55dcd1809713f23dc01f2fc5e90d9cc46ec9b"}
Sep 10 21:14:29.547649 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:29.547453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" event={"ID":"3e89ab0b-94f1-43fd-9b97-8e03c8d18459","Type":"ContainerStarted","Data":"b87bc002dd98a2cec58b3fe4ff7a190e307fb413f9abfd369212eebd7a100787"}
Sep 10 21:14:29.547649 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:29.547512    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:29.566511 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:29.566450    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" podStartSLOduration=2.232806117 podStartE2EDuration="2.566427409s" totalImagesPullingTime="333.621292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:29.564819498 +0000 UTC m=+991.998649449" watchObservedRunningTime="2026-09-10 21:14:29.566427409 +0000 UTC m=+992.000257358"
Sep 10 21:14:30.045094 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:30.045042    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" path="/var/lib/kubelet/pods/a3575cbe-ca7e-47d4-a0bd-877f4b0902b1/volumes"
Sep 10 21:14:31.370174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:31.370142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:31.472279 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:31.472241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:31.573881 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:31.573844    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:31.676594 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:31.676509    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:35.559885 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:35.559852    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:14:37.142720 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:37.142686    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:37.243076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:37.243042    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:37.311142 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:37.311101    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:38.084053 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:38.084017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:38.379323 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:38.379229    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:39.249417 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:39.249372    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:40.206920 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:40.206865    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:40.307980 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:40.307948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:41.592114 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:41.592063    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:41.690574 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:41.690526    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:42.865311 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865282    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"]
Sep 10 21:14:42.865894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865875    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy"
Sep 10 21:14:42.865894 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865896    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865912    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865918    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865931    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.865938    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.866006    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.866014    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6107ffad-ce1a-42a3-98a6-8b0fceae26d2" containerName="istio-proxy"
Sep 10 21:14:42.866020 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.866020    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3575cbe-ca7e-47d4-a0bd-877f4b0902b1" containerName="istio-proxy"
Sep 10 21:14:42.870388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.870365    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:42.872904 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.872880    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-91c25e-serving-cert\""
Sep 10 21:14:42.880428 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.880304    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"]
Sep 10 21:14:42.897379 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.897341    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:42.985101 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.985059    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/fbe69632-3406-4165-8eb7-936484ee8dda-kube-api-access-4cgps\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:42.985278 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.985121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe69632-3406-4165-8eb7-936484ee8dda-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:42.985278 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.985191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:42.985366 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.985268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:42.997906 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:42.997874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:43.054515 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.054481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:43.086715 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.086682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.086887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.086739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/fbe69632-3406-4165-8eb7-936484ee8dda-kube-api-access-4cgps\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.086887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.086790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe69632-3406-4165-8eb7-936484ee8dda-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.086887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.086814    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.087612 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.087580    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe69632-3406-4165-8eb7-936484ee8dda-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.089383 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.089358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.089513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.089358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.094221 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.094197    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/fbe69632-3406-4165-8eb7-936484ee8dda-kube-api-access-4cgps\") pod \"maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.184652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.184563    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:43.371943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.371912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:43.468454 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.468426    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"]
Sep 10 21:14:43.470225 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.470195    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:43.470912 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:14:43.470885    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe69632_3406_4165_8eb7_936484ee8dda.slice/crio-7853657af9136a4dad2c2b3185181032ac69eb25be29f1ec85768c5c73c0fed5 WatchSource:0}: Error finding container 7853657af9136a4dad2c2b3185181032ac69eb25be29f1ec85768c5c73c0fed5: Status 404 returned error can't find the container with id 7853657af9136a4dad2c2b3185181032ac69eb25be29f1ec85768c5c73c0fed5
Sep 10 21:14:43.630608 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:43.630567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v" event={"ID":"fbe69632-3406-4165-8eb7-936484ee8dda","Type":"ContainerStarted","Data":"7853657af9136a4dad2c2b3185181032ac69eb25be29f1ec85768c5c73c0fed5"}
Sep 10 21:14:44.637778 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:44.637738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v" event={"ID":"fbe69632-3406-4165-8eb7-936484ee8dda","Type":"ContainerStarted","Data":"47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af"}
Sep 10 21:14:44.638244 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:44.637848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:44.654474 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:44.654385    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v" podStartSLOduration=2.287574458 podStartE2EDuration="2.654369594s" totalImagesPullingTime="366.795136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:44.652613965 +0000 UTC m=+1007.086443915" watchObservedRunningTime="2026-09-10 21:14:44.654369594 +0000 UTC m=+1007.088199543"
Sep 10 21:14:48.981654 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:48.981576    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:50.649096 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:50.649063    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:14:51.467813 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:51.467754    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:51.766887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:51.766795    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:52.029077 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.028989    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"]
Sep 10 21:14:52.032933 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.032910    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.035388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.035363    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-4eb314-openshift-default-dockercfg-xv2w5\""
Sep 10 21:14:52.045391 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.045367    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"]
Sep 10 21:14:52.065891 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.065852    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:52.158123 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.158093    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:52.176935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.176905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc774f30-97e6-4c81-b621-4e5bc7b51955-istiod-ca-cert\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.176935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.176939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-data\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.176958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-socket\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.176986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-credential-socket\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.177088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj6rx\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-kube-api-access-lj6rx\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.177127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-certs\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.177145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-token\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177341 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.177170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-podinfo\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.177341 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.177239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-envoy\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278569 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc774f30-97e6-4c81-b621-4e5bc7b51955-istiod-ca-cert\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278569 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278576    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-data\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278845 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-socket\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278845 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-credential-socket\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278845 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj6rx\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-kube-api-access-lj6rx\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278845 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-certs\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278845 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-token\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.278845 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.278778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-podinfo\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.279188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.279008    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-data\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.279188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.279038    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-socket\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.279188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.279118    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-credential-socket\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.279188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.279134    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-certs\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.279429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.279332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc774f30-97e6-4c81-b621-4e5bc7b51955-istiod-ca-cert\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.279486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.279469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-envoy\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.281453 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.281428    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-envoy\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.281555 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.281449    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-podinfo\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.286079 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.286057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-token\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.286181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.286101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj6rx\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-kube-api-access-lj6rx\") pod \"e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") " pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.346911 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.346877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:52.620305 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.620278    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"]
Sep 10 21:14:52.622670 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:14:52.622638    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc774f30_97e6_4c81_b621_4e5bc7b51955.slice/crio-856e5ee2027775da1d7758451ee9769d3b87fdc027d0df51289ab5bf5f1df199 WatchSource:0}: Error finding container 856e5ee2027775da1d7758451ee9769d3b87fdc027d0df51289ab5bf5f1df199: Status 404 returned error can't find the container with id 856e5ee2027775da1d7758451ee9769d3b87fdc027d0df51289ab5bf5f1df199
Sep 10 21:14:52.624902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.624872    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:14:52.624984 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.624937    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:14:52.624984 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.624965    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:14:52.684919 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.684887    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" event={"ID":"bc774f30-97e6-4c81-b621-4e5bc7b51955","Type":"ContainerStarted","Data":"856e5ee2027775da1d7758451ee9769d3b87fdc027d0df51289ab5bf5f1df199"}
Sep 10 21:14:52.712514 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:52.712459    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podStartSLOduration=0.712442608 podStartE2EDuration="712.442608ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:52.71026521 +0000 UTC m=+1015.144095161" watchObservedRunningTime="2026-09-10 21:14:52.712442608 +0000 UTC m=+1015.146272556"
Sep 10 21:14:53.347505 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:53.347467    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:53.352517 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:53.352489    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:53.693071 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:53.692981    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" event={"ID":"bc774f30-97e6-4c81-b621-4e5bc7b51955","Type":"ContainerStarted","Data":"32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"}
Sep 10 21:14:53.693332 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:53.693317    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:53.694288 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:53.694268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:14:54.583878 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:54.583848    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:54.683892 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:54.683859    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:55.698710 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.698656    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"]
Sep 10 21:14:55.702902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.702880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.705513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.705484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-4eb314-serving-cert\""
Sep 10 21:14:55.715524 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.714852    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"]
Sep 10 21:14:55.740971 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.740945    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:55.813668 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.813633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.813840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.813682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jbf4\" (UniqueName: \"kubernetes.io/projected/4421fdbb-60d4-46e8-8df3-b19bdce90d50-kube-api-access-4jbf4\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.813840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.813749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4421fdbb-60d4-46e8-8df3-b19bdce90d50-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.813970 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.813951    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.841941 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.841905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:55.915492 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.915450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4421fdbb-60d4-46e8-8df3-b19bdce90d50-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.915696 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.915568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.915696 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.915674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.915817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.915715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jbf4\" (UniqueName: \"kubernetes.io/projected/4421fdbb-60d4-46e8-8df3-b19bdce90d50-kube-api-access-4jbf4\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.915817 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:55.915727    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-serving-cert: secret "maas-api-e2e-shared-b-w3-4eb314-serving-cert" not found
Sep 10 21:14:55.915817 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:14:55.915809    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls podName:4421fdbb-60d4-46e8-8df3-b19bdce90d50 nodeName:}" failed. No retries permitted until 2026-09-10 21:14:56.415785764 +0000 UTC m=+1018.849615704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls") pod "maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" (UID: "4421fdbb-60d4-46e8-8df3-b19bdce90d50") : secret "maas-api-e2e-shared-b-w3-4eb314-serving-cert" not found
Sep 10 21:14:55.916198 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.916167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4421fdbb-60d4-46e8-8df3-b19bdce90d50-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.918289 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.918268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:55.926426 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:55.926385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jbf4\" (UniqueName: \"kubernetes.io/projected/4421fdbb-60d4-46e8-8df3-b19bdce90d50-kube-api-access-4jbf4\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:56.305036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.304999    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:56.405260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.405222    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:56.421633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.421602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:56.424199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.424167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:56.487789 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.487762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:14:56.621390 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.621347    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:56.893746 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:56.893685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"]
Sep 10 21:14:56.896626 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:14:56.896584    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4421fdbb_60d4_46e8_8df3_b19bdce90d50.slice/crio-54d0871c06bc94ec8d4f2ff5fba510ca1123b5b550a2ea915e0882bc3b61f372 WatchSource:0}: Error finding container 54d0871c06bc94ec8d4f2ff5fba510ca1123b5b550a2ea915e0882bc3b61f372: Status 404 returned error can't find the container with id 54d0871c06bc94ec8d4f2ff5fba510ca1123b5b550a2ea915e0882bc3b61f372
Sep 10 21:14:57.722098 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:57.722016    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" event={"ID":"4421fdbb-60d4-46e8-8df3-b19bdce90d50","Type":"ContainerStarted","Data":"81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b"}
Sep 10 21:14:57.722098 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:57.722066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" event={"ID":"4421fdbb-60d4-46e8-8df3-b19bdce90d50","Type":"ContainerStarted","Data":"54d0871c06bc94ec8d4f2ff5fba510ca1123b5b550a2ea915e0882bc3b61f372"}
Sep 10 21:14:57.722098 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:57.722096    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:14:57.739145 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:14:57.739092    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" podStartSLOduration=2.296799775 podStartE2EDuration="2.739076937s" totalImagesPullingTime="442.277162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:57.737342871 +0000 UTC m=+1020.171172833" watchObservedRunningTime="2026-09-10 21:14:57.739076937 +0000 UTC m=+1020.172906885"
Sep 10 21:15:03.741988 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:03.741955    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:15:03.929518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:03.929462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:06.509429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:06.509338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:06.843783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:06.843752    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.085347 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.085305    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"]
Sep 10 21:15:07.091753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.091719    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.094336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.094265    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-837e16-openshift-default-dockercfg-r9tr6\""
Sep 10 21:15:07.101880 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.101850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"]
Sep 10 21:15:07.150130 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.144774    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.243746 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.243699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-socket\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.243923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.243769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-data\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.243923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.243797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6wfs\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-kube-api-access-w6wfs\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.243923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.243824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-podinfo\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.243923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.243848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istiod-ca-cert\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.244062 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.244043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-envoy\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.244107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.244064    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-token\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.244107 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.244092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-credential-socket\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.244177 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.244135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-certs\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.274572 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.274539    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:07.344825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-socket\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.344825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-data\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.344825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6wfs\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-kube-api-access-w6wfs\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.344825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-podinfo\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345164 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istiod-ca-cert\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345164 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-envoy\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345164 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344941    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-token\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345164 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.344969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-credential-socket\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345164 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.345031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-certs\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345437 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.345203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-socket\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345437 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.345242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-data\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345437 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.345374    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-certs\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345571 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.345505    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-credential-socket\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.345681 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.345661    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istiod-ca-cert\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.347178 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.347155    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-envoy\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.347325 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.347309    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-podinfo\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.354672 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.354647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6wfs\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-kube-api-access-w6wfs\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.355114 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.355093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-token\") pod \"e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") " pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.445523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.445488    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:07.734008 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.733932    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"]
Sep 10 21:15:07.736976 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:15:07.736948    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3707d2b1_ecaa_471e_aca8_b2c6d5133a49.slice/crio-5ef06eae7482142b3869ce10260aef2ccdb32589a93e13fb37be355a24210350 WatchSource:0}: Error finding container 5ef06eae7482142b3869ce10260aef2ccdb32589a93e13fb37be355a24210350: Status 404 returned error can't find the container with id 5ef06eae7482142b3869ce10260aef2ccdb32589a93e13fb37be355a24210350
Sep 10 21:15:07.739313 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.739277    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:07.739421 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.739345    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:07.739421 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.739374    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:07.777955 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:07.777926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" event={"ID":"3707d2b1-ecaa-471e-aca8-b2c6d5133a49","Type":"ContainerStarted","Data":"5ef06eae7482142b3869ce10260aef2ccdb32589a93e13fb37be355a24210350"}
Sep 10 21:15:08.786722 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:08.786680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" event={"ID":"3707d2b1-ecaa-471e-aca8-b2c6d5133a49","Type":"ContainerStarted","Data":"889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"}
Sep 10 21:15:08.808009 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:08.807942    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podStartSLOduration=1.8079169689999999 podStartE2EDuration="1.807916969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:08.805876702 +0000 UTC m=+1031.239706662" watchObservedRunningTime="2026-09-10 21:15:08.807916969 +0000 UTC m=+1031.241746919"
Sep 10 21:15:09.446319 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:09.446280    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:09.452661 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:09.452630    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:09.734673 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:09.734577    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:15:09.734673 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:09.734656    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:15:09.792674 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:09.792640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:09.793693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:09.793671    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:10.740832 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:10.740798    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:10.840601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:10.840565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:11.805869 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.805783    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerID="32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c" exitCode=0
Sep 10 21:15:11.806053 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.805863    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" event={"ID":"bc774f30-97e6-4c81-b621-4e5bc7b51955","Type":"ContainerDied","Data":"32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"}
Sep 10 21:15:11.806463 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.806446    2573 scope.go:117] "RemoveContainer" containerID="32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"
Sep 10 21:15:11.807554 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.807527    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:11.807684 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.807594    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:11.807684 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.807629    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:11.867385 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.867355    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"]
Sep 10 21:15:11.872888 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.872863    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.875661 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.875627    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-837e16-serving-cert\""
Sep 10 21:15:11.891793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.888250    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.891793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.888316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.891793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.888364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmtwh\" (UniqueName: \"kubernetes.io/projected/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-kube-api-access-tmtwh\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.891793 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.888550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.892527 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.892502    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"]
Sep 10 21:15:11.910545 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.910512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:11.990366 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.990211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.990608 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.990379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.990608 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.990494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.990608 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.990526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmtwh\" (UniqueName: \"kubernetes.io/projected/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-kube-api-access-tmtwh\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.990984 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:15:11.990943    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-serving-cert: secret "maas-api-e2e-shared-b-w2-837e16-serving-cert" not found
Sep 10 21:15:11.991201 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:15:11.991190    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls podName:f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac nodeName:}" failed. No retries permitted until 2026-09-10 21:15:12.491147173 +0000 UTC m=+1034.924977122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls") pod "maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" (UID: "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac") : secret "maas-api-e2e-shared-b-w2-837e16-serving-cert" not found
Sep 10 21:15:11.991978 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.991359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:11.993897 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:11.993872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:12.003546 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.003501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmtwh\" (UniqueName: \"kubernetes.io/projected/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-kube-api-access-tmtwh\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:12.010029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.009994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:12.273548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.273503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:12.374583 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.374552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:12.475213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.475186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:12.495751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.495713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:12.498437 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.498411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:12.792925 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.792886    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:12.818422 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:12.817157    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" event={"ID":"bc774f30-97e6-4c81-b621-4e5bc7b51955","Type":"ContainerStarted","Data":"07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582"}
Sep 10 21:15:13.088043 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.088018    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"]
Sep 10 21:15:13.092306 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:15:13.090009    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d71345_dbe6_4b19_98dd_a3ee6c5bdfac.slice/crio-be2bfb74ecfa7439eb8342843934d5ec42efd9995ef60d0d6c6d804a37f1c157 WatchSource:0}: Error finding container be2bfb74ecfa7439eb8342843934d5ec42efd9995ef60d0d6c6d804a37f1c157: Status 404 returned error can't find the container with id be2bfb74ecfa7439eb8342843934d5ec42efd9995ef60d0d6c6d804a37f1c157
Sep 10 21:15:13.347647 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.347545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:15:13.348036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.348008    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:15:13.348116 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.348076    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 21:15:13.830170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.830128    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" event={"ID":"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac","Type":"ContainerStarted","Data":"76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d"}
Sep 10 21:15:13.830469 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.830446    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" event={"ID":"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac","Type":"ContainerStarted","Data":"be2bfb74ecfa7439eb8342843934d5ec42efd9995ef60d0d6c6d804a37f1c157"}
Sep 10 21:15:13.830624 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.830611    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:13.848436 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:13.848369    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" podStartSLOduration=2.47042966 podStartE2EDuration="2.84835158s" totalImagesPullingTime="377.92192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:13.845978818 +0000 UTC m=+1036.279808768" watchObservedRunningTime="2026-09-10 21:15:13.84835158 +0000 UTC m=+1036.282181530"
Sep 10 21:15:14.347754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:14.347713    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:15:14.348265 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:14.347778    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 21:15:15.347882 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:15.347847    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:15:15.348294 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:15.347903    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 21:15:16.348286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:16.348249    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:15:16.348671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:16.348307    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 21:15:17.347639 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:17.347594    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 21:15:17.347851 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:17.347677    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 21:15:17.598560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:17.598483    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:18.351387 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:18.351356    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:15:18.351700 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:18.351681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:15:18.352676 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:18.352656    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:15:19.488915 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:19.488879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:20.846328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:20.846298    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:15:30.930471 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:30.930347    2573 generic.go:356] "Generic (PLEG): container finished" podID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerID="889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d" exitCode=0
Sep 10 21:15:30.930471 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:30.930436    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" event={"ID":"3707d2b1-ecaa-471e-aca8-b2c6d5133a49","Type":"ContainerDied","Data":"889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"}
Sep 10 21:15:30.931048 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:30.930968    2573 scope.go:117] "RemoveContainer" containerID="889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"
Sep 10 21:15:30.932867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:30.932830    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:30.932971 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:30.932924    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:30.933042 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:30.932973    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:15:31.941923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:31.941876    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" event={"ID":"3707d2b1-ecaa-471e-aca8-b2c6d5133a49","Type":"ContainerStarted","Data":"b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd"}
Sep 10 21:15:32.446789 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:32.446759    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:32.447103 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:32.447030    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 21:15:32.447220 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:32.447205    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 21:15:33.445976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:33.445942    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 21:15:33.446350 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:33.445996    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 21:15:34.170771 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:34.170734    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:34.446336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:34.446232    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 21:15:34.447375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:34.446928    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 21:15:35.447084 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:35.446600    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 21:15:35.447084 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:35.446696    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 21:15:35.672468 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:35.672413    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:36.446688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:36.446657    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 21:15:36.446889 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:36.446719    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 21:15:37.523024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:37.522989    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:37.523556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:37.523524    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:37.525119 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:37.525093    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:15:39.571282 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:39.571226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:44.360518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:44.360482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:44.661477 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:44.661332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:44.761737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:44.761708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:48.048216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:48.048186    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:48.148297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:48.148249    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.155432 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.155378    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"]
Sep 10 21:15:49.159485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.159462    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.161554 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.161531    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8ba2d470-serving-cert\""
Sep 10 21:15:49.170575 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.170547    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"]
Sep 10 21:15:49.188823 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.188780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.201586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.201545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.201777 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.201637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26c85\" (UniqueName: \"kubernetes.io/projected/65beaaa4-862b-490f-a494-ad7f7880c928-kube-api-access-26c85\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.201777 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.201719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65beaaa4-862b-490f-a494-ad7f7880c928-openshift-service-ca\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.201777 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.201759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-metrics-certs\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.289494 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.289462    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.303073 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.303039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.303267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.303106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26c85\" (UniqueName: \"kubernetes.io/projected/65beaaa4-862b-490f-a494-ad7f7880c928-kube-api-access-26c85\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.303267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.303165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65beaaa4-862b-490f-a494-ad7f7880c928-openshift-service-ca\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.303267 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.303194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-metrics-certs\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.303267 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:15:49.303206    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-serving-cert: secret "maas-api-e2e-mt-8ba2d470-serving-cert" not found
Sep 10 21:15:49.303572 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:15:49.303278    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls podName:65beaaa4-862b-490f-a494-ad7f7880c928 nodeName:}" failed. No retries permitted until 2026-09-10 21:15:49.803255655 +0000 UTC m=+1072.237085582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls") pod "maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" (UID: "65beaaa4-862b-490f-a494-ad7f7880c928") : secret "maas-api-e2e-mt-8ba2d470-serving-cert" not found
Sep 10 21:15:49.304198 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.304176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65beaaa4-862b-490f-a494-ad7f7880c928-openshift-service-ca\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.306089 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.306068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-metrics-certs\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.313995 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.313958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26c85\" (UniqueName: \"kubernetes.io/projected/65beaaa4-862b-490f-a494-ad7f7880c928-kube-api-access-26c85\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.412566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.412480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.676106 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.676005    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.779627 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.779594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:15:49.808252 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.808213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:49.811505 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:49.811477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls\") pod \"maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:50.073091 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:50.073052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:50.354215 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:50.354181    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"]
Sep 10 21:15:50.355730 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:15:50.355701    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65beaaa4_862b_490f_a494_ad7f7880c928.slice/crio-539d5b68dcb1e960e78d3c06c832d534963579a6e054cec917402b2701e5dfa5 WatchSource:0}: Error finding container 539d5b68dcb1e960e78d3c06c832d534963579a6e054cec917402b2701e5dfa5: Status 404 returned error can't find the container with id 539d5b68dcb1e960e78d3c06c832d534963579a6e054cec917402b2701e5dfa5
Sep 10 21:15:51.064849 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:51.064759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" event={"ID":"65beaaa4-862b-490f-a494-ad7f7880c928","Type":"ContainerStarted","Data":"3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e"}
Sep 10 21:15:51.065024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:51.064851    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:15:51.065024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:51.064875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" event={"ID":"65beaaa4-862b-490f-a494-ad7f7880c928","Type":"ContainerStarted","Data":"539d5b68dcb1e960e78d3c06c832d534963579a6e054cec917402b2701e5dfa5"}
Sep 10 21:15:51.082930 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:51.082873    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" podStartSLOduration=1.6584417839999999 podStartE2EDuration="2.082854019s" totalImagesPullingTime="424.412235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:51.080607565 +0000 UTC m=+1073.514437527" watchObservedRunningTime="2026-09-10 21:15:51.082854019 +0000 UTC m=+1073.516683969"
Sep 10 21:15:57.078439 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:15:57.078383    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:16:12.995039 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:12.995002    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:24.170140 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:24.170106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:27.658053 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:27.658017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:37.992973 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:37.992939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:47.185510 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:47.185467    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:48.530083 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:48.530048    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:16:48.584621 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:16:48.584582    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:18.002348 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:18.002314    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:25.270983 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:25.270897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:25.326051 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:25.326022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:28.757185 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:28.757151    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:33.297087 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.297055    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"]
Sep 10 21:17:33.297584 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.297332    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" podUID="65beaaa4-862b-490f-a494-ad7f7880c928" containerName="maas-api" containerID="cri-o://3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e" gracePeriod=30
Sep 10 21:17:33.322979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.322952    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:33.390616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.390572    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:33.454370 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.454334    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:33.523220 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.523183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:33.561725 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.561663    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:17:33.639281 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.639251    2573 generic.go:356] "Generic (PLEG): container finished" podID="65beaaa4-862b-490f-a494-ad7f7880c928" containerID="3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e" exitCode=0
Sep 10 21:17:33.639486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.639302    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"
Sep 10 21:17:33.639486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.639335    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" event={"ID":"65beaaa4-862b-490f-a494-ad7f7880c928","Type":"ContainerDied","Data":"3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e"}
Sep 10 21:17:33.639486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.639391    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk" event={"ID":"65beaaa4-862b-490f-a494-ad7f7880c928","Type":"ContainerDied","Data":"539d5b68dcb1e960e78d3c06c832d534963579a6e054cec917402b2701e5dfa5"}
Sep 10 21:17:33.639486 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.639424    2573 scope.go:117] "RemoveContainer" containerID="3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e"
Sep 10 21:17:33.660563 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.660538    2573 scope.go:117] "RemoveContainer" containerID="3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e"
Sep 10 21:17:33.661104 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:17:33.661072    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e\": container with ID starting with 3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e not found: ID does not exist" containerID="3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e"
Sep 10 21:17:33.661209 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.661117    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e"} err="failed to get container status \"3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e\": rpc error: code = NotFound desc = could not find container \"3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e\": container with ID starting with 3c85a41f990fc9b23ca18a980c658668bf7376b69654ef72c1bf8fa4a124542e not found: ID does not exist"
Sep 10 21:17:33.694042 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.694012    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26c85\" (UniqueName: \"kubernetes.io/projected/65beaaa4-862b-490f-a494-ad7f7880c928-kube-api-access-26c85\") pod \"65beaaa4-862b-490f-a494-ad7f7880c928\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") "
Sep 10 21:17:33.694218 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.694051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65beaaa4-862b-490f-a494-ad7f7880c928-openshift-service-ca\") pod \"65beaaa4-862b-490f-a494-ad7f7880c928\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") "
Sep 10 21:17:33.694218 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.694130    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls\") pod \"65beaaa4-862b-490f-a494-ad7f7880c928\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") "
Sep 10 21:17:33.694218 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.694156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-metrics-certs\") pod \"65beaaa4-862b-490f-a494-ad7f7880c928\" (UID: \"65beaaa4-862b-490f-a494-ad7f7880c928\") "
Sep 10 21:17:33.694484 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.694454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65beaaa4-862b-490f-a494-ad7f7880c928-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65beaaa4-862b-490f-a494-ad7f7880c928" (UID: "65beaaa4-862b-490f-a494-ad7f7880c928"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:17:33.694618 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.694600    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65beaaa4-862b-490f-a494-ad7f7880c928-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:17:33.696159 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.696097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65beaaa4-862b-490f-a494-ad7f7880c928" (UID: "65beaaa4-862b-490f-a494-ad7f7880c928"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:17:33.696256 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.696157    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65beaaa4-862b-490f-a494-ad7f7880c928-kube-api-access-26c85" (OuterVolumeSpecName: "kube-api-access-26c85") pod "65beaaa4-862b-490f-a494-ad7f7880c928" (UID: "65beaaa4-862b-490f-a494-ad7f7880c928"). InnerVolumeSpecName "kube-api-access-26c85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:17:33.696435 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.696390    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "65beaaa4-862b-490f-a494-ad7f7880c928" (UID: "65beaaa4-862b-490f-a494-ad7f7880c928"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:17:33.795307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.795275    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:17:33.795307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.795302    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65beaaa4-862b-490f-a494-ad7f7880c928-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:17:33.795307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.795310    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26c85\" (UniqueName: \"kubernetes.io/projected/65beaaa4-862b-490f-a494-ad7f7880c928-kube-api-access-26c85\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:17:33.961836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.961805    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"]
Sep 10 21:17:33.970027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:33.969996    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8ba2d470-7c87555b66-hs7pk"]
Sep 10 21:17:34.043901 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:34.043867    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65beaaa4-862b-490f-a494-ad7f7880c928" path="/var/lib/kubelet/pods/65beaaa4-862b-490f-a494-ad7f7880c928/volumes"
Sep 10 21:17:36.476729 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:36.476690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:41.512159 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:41.512129    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:51.294664 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:51.294622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:17:58.090378 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:58.090350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:17:58.094044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:17:58.094017    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:18:18.292098 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:18.292039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:18.630754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:18.630709    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:24.071933 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:24.071900    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:24.172992 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:24.172949    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:24.317592 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:24.317552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:25.518265 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:25.518230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:25.618447 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:25.618414    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:25.718436 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:25.718374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:26.383681 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:26.383650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:26.480691 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:26.480661    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:26.585677 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:26.585634    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:27.772460 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:27.772419    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:33.303985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:33.303939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:33.357958 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:33.357923    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:33.946019 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:33.945984    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:37.989809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:37.989778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:39.066496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:39.066460    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:39.738184 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:39.738146    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:39.799798 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:39.799769    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:39.871522 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:39.871489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:48.853505 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:48.853464    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:50.391659 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:50.391550    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:18:50.622802 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:18:50.622761    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:09.598460 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:09.598429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:11.534501 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:11.534465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:17.301732 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.301697    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:17.402114 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.402072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:17.639548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.639512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:17.951371 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.951276    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"]
Sep 10 21:19:17.951866 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.951847    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65beaaa4-862b-490f-a494-ad7f7880c928" containerName="maas-api"
Sep 10 21:19:17.951959 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.951869    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="65beaaa4-862b-490f-a494-ad7f7880c928" containerName="maas-api"
Sep 10 21:19:17.952013 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.951980    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="65beaaa4-862b-490f-a494-ad7f7880c928" containerName="maas-api"
Sep 10 21:19:17.955410 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.955367    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:17.958175 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.958149    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3a1a62-openshift-default-dockercfg-fmqcj\""
Sep 10 21:19:17.968304 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.968272    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"]
Sep 10 21:19:17.973926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:17.973888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:18.062763 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-data\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.062969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-socket\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.062969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-certs\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.062969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-podinfo\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.062969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxd64\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-kube-api-access-rxd64\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.062969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-envoy\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.063237 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istiod-ca-cert\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.063237 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.062998    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-credential-socket\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.063237 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.063025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-token\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.163895 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.163848    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-podinfo\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164121 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.163956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxd64\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-kube-api-access-rxd64\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164121 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.163984    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-envoy\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164121 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istiod-ca-cert\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164121 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-credential-socket\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164121 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-token\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-data\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164240    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-socket\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-certs\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164616 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164587    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-credential-socket\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164740 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-certs\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.164830 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164771    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-data\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.165017 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-socket\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.165017 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.164968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istiod-ca-cert\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.166695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.166674    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-envoy\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.167295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.167279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-podinfo\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.172743 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.172721    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-token\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.173090 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.173065    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxd64\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-kube-api-access-rxd64\") pod \"e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") " pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.180569 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.180545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:18.270236 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.270142    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:18.557634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.557603    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"]
Sep 10 21:19:18.559051 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:19:18.559023    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d3c270_00b4_456a_9d42_b3bd5be31d92.slice/crio-4ac53e723ce985cfd2610b1e6202dc5502f1763fc69d174e94ed441712f299ed WatchSource:0}: Error finding container 4ac53e723ce985cfd2610b1e6202dc5502f1763fc69d174e94ed441712f299ed: Status 404 returned error can't find the container with id 4ac53e723ce985cfd2610b1e6202dc5502f1763fc69d174e94ed441712f299ed
Sep 10 21:19:18.561669 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.561639    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:19:18.561765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.561709    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:19:18.561765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:18.561739    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:19:19.240320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:19.240283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" event={"ID":"d3d3c270-00b4-456a-9d42-b3bd5be31d92","Type":"ContainerStarted","Data":"7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"}
Sep 10 21:19:19.240532 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:19.240344    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" event={"ID":"d3d3c270-00b4-456a-9d42-b3bd5be31d92","Type":"ContainerStarted","Data":"4ac53e723ce985cfd2610b1e6202dc5502f1763fc69d174e94ed441712f299ed"}
Sep 10 21:19:19.262471 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:19.262420    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podStartSLOduration=2.2623896820000002 podStartE2EDuration="2.262389682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:19.259607991 +0000 UTC m=+1281.693437943" watchObservedRunningTime="2026-09-10 21:19:19.262389682 +0000 UTC m=+1281.696219631"
Sep 10 21:19:19.270596 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:19.270562    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:19.276260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:19.276234    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:20.251453 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:20.248580    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:20.254170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:20.254137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:21.152707 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:21.152650    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:21.253100 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:21.253072    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:22.290935 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:22.290902    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:22.357384 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:22.357346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:22.455585 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:22.455552    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:22.768166 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:22.768136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:22.845579 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:22.845543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:42.382887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:42.382850    2573 generic.go:356] "Generic (PLEG): container finished" podID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerID="7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3" exitCode=0
Sep 10 21:19:42.383321 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:42.382903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" event={"ID":"d3d3c270-00b4-456a-9d42-b3bd5be31d92","Type":"ContainerDied","Data":"7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"}
Sep 10 21:19:42.383364 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:42.383356    2573 scope.go:117] "RemoveContainer" containerID="7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"
Sep 10 21:19:42.384575 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:42.384543    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:19:42.384668 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:42.384616    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:19:42.384668 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:42.384647    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:19:43.390796 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:43.390759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" event={"ID":"d3d3c270-00b4-456a-9d42-b3bd5be31d92","Type":"ContainerStarted","Data":"f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee"}
Sep 10 21:19:44.270669 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:44.270622    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:44.270887 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:44.270863    2573 patch_prober.go:28] interesting pod/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 21:19:44.270986 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:44.270948    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 21:19:45.271109 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:45.271064    2573 patch_prober.go:28] interesting pod/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 21:19:45.271559 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:45.271129    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 21:19:46.110098 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:46.110030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:46.270854 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:46.270814    2573 patch_prober.go:28] interesting pod/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 21:19:46.271029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:46.270883    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 21:19:46.542003 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:46.541886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:46.831506 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:46.831469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:46.965944 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:46.965886    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:47.270901 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:47.270793    2573 patch_prober.go:28] interesting pod/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 21:19:47.271084 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:47.270894    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 21:19:48.271659 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:48.271620    2573 patch_prober.go:28] interesting pod/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 10 21:19:48.272070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:48.271691    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 10 21:19:49.274923 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:49.274889    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:49.275298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:49.275177    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:49.276161 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:49.276138    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:19:49.560966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:49.560880    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:49.656002 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:49.655965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:49.789671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:49.789636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:50.675175 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.675138    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"]
Sep 10 21:19:50.679383 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.679348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.685589 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.685557    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-044266-serving-cert\""
Sep 10 21:19:50.691578 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.691548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"]
Sep 10 21:19:50.719696 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.719660    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:50.723994 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.723962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw64f\" (UniqueName: \"kubernetes.io/projected/a2baa7f3-6597-4b56-a24e-677b98de75f4-kube-api-access-gw64f\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.724181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.724005    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2baa7f3-6597-4b56-a24e-677b98de75f4-openshift-service-ca\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.724181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.724114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-maas-api-tls\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.724181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.724151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-metrics-certs\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.816350 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.816315    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:50.825740 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.825704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2baa7f3-6597-4b56-a24e-677b98de75f4-openshift-service-ca\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.825916 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.825798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-maas-api-tls\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.825916 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.825841    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-metrics-certs\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.826029 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.825917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw64f\" (UniqueName: \"kubernetes.io/projected/a2baa7f3-6597-4b56-a24e-677b98de75f4-kube-api-access-gw64f\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.826553 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.826518    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2baa7f3-6597-4b56-a24e-677b98de75f4-openshift-service-ca\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.828454 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.828387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-maas-api-tls\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.828706 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.828686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-metrics-certs\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.833841 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.833818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw64f\" (UniqueName: \"kubernetes.io/projected/a2baa7f3-6597-4b56-a24e-677b98de75f4-kube-api-access-gw64f\") pod \"maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:50.993734 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:50.993641    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:51.181558 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:51.181519    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:51.271380 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:51.271351    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"]
Sep 10 21:19:51.273017 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:19:51.272981    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2baa7f3_6597_4b56_a24e_677b98de75f4.slice/crio-9d68bdbaa8bb360b42295b69a2b48447770707a52d1150a26d2e7c30af719027 WatchSource:0}: Error finding container 9d68bdbaa8bb360b42295b69a2b48447770707a52d1150a26d2e7c30af719027: Status 404 returned error can't find the container with id 9d68bdbaa8bb360b42295b69a2b48447770707a52d1150a26d2e7c30af719027
Sep 10 21:19:51.273456 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:51.273438    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:19:51.274516 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:51.274498    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:19:51.444898 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:51.444852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9" event={"ID":"a2baa7f3-6597-4b56-a24e-677b98de75f4","Type":"ContainerStarted","Data":"9d68bdbaa8bb360b42295b69a2b48447770707a52d1150a26d2e7c30af719027"}
Sep 10 21:19:52.452849 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:52.452809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9" event={"ID":"a2baa7f3-6597-4b56-a24e-677b98de75f4","Type":"ContainerStarted","Data":"4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5"}
Sep 10 21:19:52.453276 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:52.452875    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:19:52.471621 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:52.471565    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9" podStartSLOduration=2.113840982 podStartE2EDuration="2.471545488s" totalImagesPullingTime="357.704506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:19:52.469702482 +0000 UTC m=+1314.903532435" watchObservedRunningTime="2026-09-10 21:19:52.471545488 +0000 UTC m=+1314.905375436"
Sep 10 21:19:58.463778 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:19:58.463745    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:20:04.648359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:04.648323    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:10.458558 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:10.458521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:11.683031 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:11.682996    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:14.485755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:14.485717    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:17.514466 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:17.514430    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:18.758208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:18.758172    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:27.396982 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:27.396951    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:32.956097 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:32.956052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:33.055689 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:33.055654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:33.135050 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:33.135014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:33.186619 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:33.186585    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:33.473432 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:33.473391    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:34.904863 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:34.904835    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:35.181533 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:35.181455    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:36.260946 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:36.260917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:39.013601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:39.013565    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:39.113408 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:39.113362    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:39.276180 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:39.276089    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"]
Sep 10 21:20:39.276341 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:39.276306    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy" containerID="cri-o://f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee" gracePeriod=30
Sep 10 21:20:39.299460 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:39.299384    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:39.782628 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:39.782597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:44.544197 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.544119    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:20:44.611086 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611044    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-socket\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611138    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-podinfo\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611193    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-credential-socket\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611241    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxd64\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-kube-api-access-rxd64\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611299 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611279    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-token\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611307    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-data\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611343    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-envoy\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611384    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istiod-ca-cert\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611429    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-certs\") pod \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\" (UID: \"d3d3c270-00b4-456a-9d42-b3bd5be31d92\") "
Sep 10 21:20:44.611754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611665    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:44.611754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611695    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:44.611969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:44.611969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611955    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.611969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.611971    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.612239 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.612016    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:20:44.612239 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.612203    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:44.613849 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.613816    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:20:44.614170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.614140    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:20:44.614170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.614166    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:20:44.614341 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.614251    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-kube-api-access-rxd64" (OuterVolumeSpecName: "kube-api-access-rxd64") pod "d3d3c270-00b4-456a-9d42-b3bd5be31d92" (UID: "d3d3c270-00b4-456a-9d42-b3bd5be31d92"). InnerVolumeSpecName "kube-api-access-rxd64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:20:44.712817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712778    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.712817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712811    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.712817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712822    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxd64\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-kube-api-access-rxd64\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.713070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712832    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.713070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712841    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.713070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712848    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3d3c270-00b4-456a-9d42-b3bd5be31d92-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.713070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.712856    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3d3c270-00b4-456a-9d42-b3bd5be31d92-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:44.750889 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.750858    2573 generic.go:356] "Generic (PLEG): container finished" podID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerID="f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee" exitCode=0
Sep 10 21:20:44.751074 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.750897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" event={"ID":"d3d3c270-00b4-456a-9d42-b3bd5be31d92","Type":"ContainerDied","Data":"f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee"}
Sep 10 21:20:44.751074 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.750911    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"
Sep 10 21:20:44.751074 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.750939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg" event={"ID":"d3d3c270-00b4-456a-9d42-b3bd5be31d92","Type":"ContainerDied","Data":"4ac53e723ce985cfd2610b1e6202dc5502f1763fc69d174e94ed441712f299ed"}
Sep 10 21:20:44.751074 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.750963    2573 scope.go:117] "RemoveContainer" containerID="f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee"
Sep 10 21:20:44.762653 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.762632    2573 scope.go:117] "RemoveContainer" containerID="7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"
Sep 10 21:20:44.772280 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.772250    2573 scope.go:117] "RemoveContainer" containerID="f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee"
Sep 10 21:20:44.772701 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:20:44.772677    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee\": container with ID starting with f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee not found: ID does not exist" containerID="f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee"
Sep 10 21:20:44.772801 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.772716    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee"} err="failed to get container status \"f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee\": rpc error: code = NotFound desc = could not find container \"f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee\": container with ID starting with f31812d32c165053183c0f81398c540667b23e56a5da274bbdafd8eb1d09ebee not found: ID does not exist"
Sep 10 21:20:44.772801 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.772743    2573 scope.go:117] "RemoveContainer" containerID="7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"
Sep 10 21:20:44.773061 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:20:44.773041    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3\": container with ID starting with 7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3 not found: ID does not exist" containerID="7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"
Sep 10 21:20:44.773109 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.773068    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3"} err="failed to get container status \"7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3\": rpc error: code = NotFound desc = could not find container \"7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3\": container with ID starting with 7db59f3db907cc63e7e1f02cd03cfb52888469721a43884f1d9fd2b0e765e2c3 not found: ID does not exist"
Sep 10 21:20:44.775063 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.775040    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"]
Sep 10 21:20:44.778687 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:44.778661    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg"]
Sep 10 21:20:46.044298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:46.044262    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" path="/var/lib/kubelet/pods/d3d3c270-00b4-456a-9d42-b3bd5be31d92/volumes"
Sep 10 21:20:47.078766 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:47.078733    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:54.995996 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:54.995955    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"]
Sep 10 21:20:54.996646 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:54.996243    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9" podUID="a2baa7f3-6597-4b56-a24e-677b98de75f4" containerName="maas-api" containerID="cri-o://4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5" gracePeriod=30
Sep 10 21:20:55.027199 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.027168    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:55.095071 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.095022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:55.158161 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.158128    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:55.225741 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.225711    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:55.266711 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.266686    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:20:55.331611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.331580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2baa7f3-6597-4b56-a24e-677b98de75f4-openshift-service-ca\") pod \"a2baa7f3-6597-4b56-a24e-677b98de75f4\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") "
Sep 10 21:20:55.331783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.331646    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-metrics-certs\") pod \"a2baa7f3-6597-4b56-a24e-677b98de75f4\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") "
Sep 10 21:20:55.331783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.331670    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-maas-api-tls\") pod \"a2baa7f3-6597-4b56-a24e-677b98de75f4\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") "
Sep 10 21:20:55.331783 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.331733    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw64f\" (UniqueName: \"kubernetes.io/projected/a2baa7f3-6597-4b56-a24e-677b98de75f4-kube-api-access-gw64f\") pod \"a2baa7f3-6597-4b56-a24e-677b98de75f4\" (UID: \"a2baa7f3-6597-4b56-a24e-677b98de75f4\") "
Sep 10 21:20:55.332036 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.332011    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2baa7f3-6597-4b56-a24e-677b98de75f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2baa7f3-6597-4b56-a24e-677b98de75f4" (UID: "a2baa7f3-6597-4b56-a24e-677b98de75f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:20:55.333866 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.333832    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a2baa7f3-6597-4b56-a24e-677b98de75f4" (UID: "a2baa7f3-6597-4b56-a24e-677b98de75f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:20:55.334005 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.333878    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2baa7f3-6597-4b56-a24e-677b98de75f4" (UID: "a2baa7f3-6597-4b56-a24e-677b98de75f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:20:55.334005 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.333882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2baa7f3-6597-4b56-a24e-677b98de75f4-kube-api-access-gw64f" (OuterVolumeSpecName: "kube-api-access-gw64f") pod "a2baa7f3-6597-4b56-a24e-677b98de75f4" (UID: "a2baa7f3-6597-4b56-a24e-677b98de75f4"). InnerVolumeSpecName "kube-api-access-gw64f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:20:55.432781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.432727    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2baa7f3-6597-4b56-a24e-677b98de75f4-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:55.432781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.432773    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:55.432781 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.432786    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2baa7f3-6597-4b56-a24e-677b98de75f4-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:55.433032 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.432798    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw64f\" (UniqueName: \"kubernetes.io/projected/a2baa7f3-6597-4b56-a24e-677b98de75f4-kube-api-access-gw64f\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:20:55.557930 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.557837    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:20:55.813893 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.813795    2573 generic.go:356] "Generic (PLEG): container finished" podID="a2baa7f3-6597-4b56-a24e-677b98de75f4" containerID="4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5" exitCode=0
Sep 10 21:20:55.813893 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.813841    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"
Sep 10 21:20:55.813893 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.813879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9" event={"ID":"a2baa7f3-6597-4b56-a24e-677b98de75f4","Type":"ContainerDied","Data":"4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5"}
Sep 10 21:20:55.814190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.813939    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9" event={"ID":"a2baa7f3-6597-4b56-a24e-677b98de75f4","Type":"ContainerDied","Data":"9d68bdbaa8bb360b42295b69a2b48447770707a52d1150a26d2e7c30af719027"}
Sep 10 21:20:55.814190 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.813962    2573 scope.go:117] "RemoveContainer" containerID="4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5"
Sep 10 21:20:55.824658 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.824637    2573 scope.go:117] "RemoveContainer" containerID="4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5"
Sep 10 21:20:55.825009 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:20:55.824991    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5\": container with ID starting with 4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5 not found: ID does not exist" containerID="4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5"
Sep 10 21:20:55.825058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.825019    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5"} err="failed to get container status \"4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5\": rpc error: code = NotFound desc = could not find container \"4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5\": container with ID starting with 4cb12bebb3720158799caaee7115dbf3ef3a6075f20f24e870b725d63142efd5 not found: ID does not exist"
Sep 10 21:20:55.836610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.836575    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"]
Sep 10 21:20:55.840245 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:55.840215    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-044266-6b64bc56bd-xwdz9"]
Sep 10 21:20:56.044302 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:20:56.044269    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2baa7f3-6597-4b56-a24e-677b98de75f4" path="/var/lib/kubelet/pods/a2baa7f3-6597-4b56-a24e-677b98de75f4/volumes"
Sep 10 21:21:01.218070 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:01.218038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:01.319986 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:01.319939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:01.496716 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:01.496625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:01.908373 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:01.908338    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.219171 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.219137    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"]
Sep 10 21:21:12.220084 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.220041    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v" podUID="fbe69632-3406-4165-8eb7-936484ee8dda" containerName="maas-api" containerID="cri-o://47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af" gracePeriod=30
Sep 10 21:21:12.252448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.252416    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.349914 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.349879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.445621 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.445586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.480369 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.480309    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:21:12.507015 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.506971    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.519188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.519153    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe69632-3406-4165-8eb7-936484ee8dda-openshift-service-ca\") pod \"fbe69632-3406-4165-8eb7-936484ee8dda\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") "
Sep 10 21:21:12.519375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.519211    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-metrics-certs\") pod \"fbe69632-3406-4165-8eb7-936484ee8dda\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") "
Sep 10 21:21:12.519375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.519266    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/fbe69632-3406-4165-8eb7-936484ee8dda-kube-api-access-4cgps\") pod \"fbe69632-3406-4165-8eb7-936484ee8dda\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") "
Sep 10 21:21:12.519375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.519285    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-maas-api-tls\") pod \"fbe69632-3406-4165-8eb7-936484ee8dda\" (UID: \"fbe69632-3406-4165-8eb7-936484ee8dda\") "
Sep 10 21:21:12.519610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.519583    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe69632-3406-4165-8eb7-936484ee8dda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbe69632-3406-4165-8eb7-936484ee8dda" (UID: "fbe69632-3406-4165-8eb7-936484ee8dda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:12.519792 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.519769    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe69632-3406-4165-8eb7-936484ee8dda-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:12.521474 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.521446    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbe69632-3406-4165-8eb7-936484ee8dda" (UID: "fbe69632-3406-4165-8eb7-936484ee8dda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:12.521850 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.521831    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe69632-3406-4165-8eb7-936484ee8dda-kube-api-access-4cgps" (OuterVolumeSpecName: "kube-api-access-4cgps") pod "fbe69632-3406-4165-8eb7-936484ee8dda" (UID: "fbe69632-3406-4165-8eb7-936484ee8dda"). InnerVolumeSpecName "kube-api-access-4cgps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:12.521850 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.521838    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fbe69632-3406-4165-8eb7-936484ee8dda" (UID: "fbe69632-3406-4165-8eb7-936484ee8dda"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:12.620668 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.620631    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:12.620668 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.620663    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cgps\" (UniqueName: \"kubernetes.io/projected/fbe69632-3406-4165-8eb7-936484ee8dda-kube-api-access-4cgps\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:12.620668 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.620672    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe69632-3406-4165-8eb7-936484ee8dda-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:12.797827 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.797744    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:12.912260 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.912225    2573 generic.go:356] "Generic (PLEG): container finished" podID="fbe69632-3406-4165-8eb7-936484ee8dda" containerID="47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af" exitCode=0
Sep 10 21:21:12.912485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.912266    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"
Sep 10 21:21:12.912485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.912315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v" event={"ID":"fbe69632-3406-4165-8eb7-936484ee8dda","Type":"ContainerDied","Data":"47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af"}
Sep 10 21:21:12.912485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.912381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v" event={"ID":"fbe69632-3406-4165-8eb7-936484ee8dda","Type":"ContainerDied","Data":"7853657af9136a4dad2c2b3185181032ac69eb25be29f1ec85768c5c73c0fed5"}
Sep 10 21:21:12.912485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.912442    2573 scope.go:117] "RemoveContainer" containerID="47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af"
Sep 10 21:21:12.922241 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.922224    2573 scope.go:117] "RemoveContainer" containerID="47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af"
Sep 10 21:21:12.922570 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:21:12.922553    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af\": container with ID starting with 47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af not found: ID does not exist" containerID="47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af"
Sep 10 21:21:12.922633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.922579    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af"} err="failed to get container status \"47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af\": rpc error: code = NotFound desc = could not find container \"47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af\": container with ID starting with 47f78aa42aaa03181246a1f01d1ab4a41f3a1e30675df1add53e661e6f0c52af not found: ID does not exist"
Sep 10 21:21:12.933724 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.933696    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"]
Sep 10 21:21:12.935791 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:12.935770    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-91c25e-865f5cbc4f-wbt9v"]
Sep 10 21:21:14.044061 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:14.044026    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe69632-3406-4165-8eb7-936484ee8dda" path="/var/lib/kubelet/pods/fbe69632-3406-4165-8eb7-936484ee8dda/volumes"
Sep 10 21:21:18.454516 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:18.454478    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:18.515663 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:18.515630    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:18.698562 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:18.698528    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:19.280905 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:19.280864    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:22.054861 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:22.054832    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.415031 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.414988    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"]
Sep 10 21:21:29.415549 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.415265    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" podUID="f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" containerName="maas-api" containerID="cri-o://76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d" gracePeriod=30
Sep 10 21:21:29.447998 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.447965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.522027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.521967    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.628182 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.628136    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.676453 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.676352    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:21:29.690418 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.690366    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:29.797784 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.797742    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-metrics-certs\") pod \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") "
Sep 10 21:21:29.797963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.797813    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmtwh\" (UniqueName: \"kubernetes.io/projected/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-kube-api-access-tmtwh\") pod \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") "
Sep 10 21:21:29.797963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.797848    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-openshift-service-ca\") pod \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") "
Sep 10 21:21:29.797963 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.797913    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls\") pod \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\" (UID: \"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac\") "
Sep 10 21:21:29.798290 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.798258    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" (UID: "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:29.799981 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.799952    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" (UID: "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:29.800076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.800002    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" (UID: "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:21:29.800076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.800031    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-kube-api-access-tmtwh" (OuterVolumeSpecName: "kube-api-access-tmtwh") pod "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" (UID: "f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac"). InnerVolumeSpecName "kube-api-access-tmtwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:29.899576 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.899538    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:29.899576 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.899572    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:29.899576 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.899581    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmtwh\" (UniqueName: \"kubernetes.io/projected/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-kube-api-access-tmtwh\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:29.899827 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:29.899590    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:30.006994 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.006907    2573 generic.go:356] "Generic (PLEG): container finished" podID="f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" containerID="76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d" exitCode=0
Sep 10 21:21:30.006994 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.006954    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"
Sep 10 21:21:30.007193 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.006999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" event={"ID":"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac","Type":"ContainerDied","Data":"76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d"}
Sep 10 21:21:30.007193 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.007061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr" event={"ID":"f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac","Type":"ContainerDied","Data":"be2bfb74ecfa7439eb8342843934d5ec42efd9995ef60d0d6c6d804a37f1c157"}
Sep 10 21:21:30.007193 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.007094    2573 scope.go:117] "RemoveContainer" containerID="76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d"
Sep 10 21:21:30.017356 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.017339    2573 scope.go:117] "RemoveContainer" containerID="76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d"
Sep 10 21:21:30.017703 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:21:30.017685    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d\": container with ID starting with 76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d not found: ID does not exist" containerID="76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d"
Sep 10 21:21:30.017774 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.017712    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d"} err="failed to get container status \"76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d\": rpc error: code = NotFound desc = could not find container \"76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d\": container with ID starting with 76e6fd99cd1cd3733542bddd3ae9da6d15d25862c107ae77cc5cd13188c7982d not found: ID does not exist"
Sep 10 21:21:30.030068 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.030039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:30.031757 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.031732    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"]
Sep 10 21:21:30.035222 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.035199    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-837e16-68547b5d8c-842pr"]
Sep 10 21:21:30.044184 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:30.044148    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" path="/var/lib/kubelet/pods/f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac/volumes"
Sep 10 21:21:35.770488 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:35.770452    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:35.822302 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:35.822271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:35.996536 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:35.996500    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"]
Sep 10 21:21:35.996784 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:35.996758    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" containerID="cri-o://b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd" gracePeriod=30
Sep 10 21:21:36.011633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:36.011607    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:37.526044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:37.526011    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:21:37.526457 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:37.526068    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:21:38.963030 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:38.962969    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:41.252931 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.252906    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:21:41.420867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.420832    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-token\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421061 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.420911    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6wfs\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-kube-api-access-w6wfs\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421061 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.420954    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-socket\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421058    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-certs\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421108    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-data\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421154 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421137    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istiod-ca-cert\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421276 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421173    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:41.421276 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421226    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-envoy\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421384 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421290    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-credential-socket\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421384 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421323    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-podinfo\") pod \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\" (UID: \"3707d2b1-ecaa-471e-aca8-b2c6d5133a49\") "
Sep 10 21:21:41.421384 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421349    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:41.421582 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421436    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-data" (OuterVolumeSpecName: "istio-data") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:41.421582 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421517    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:41.421706 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421624    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:41.421764 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421745    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.421819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421767    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.421819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421781    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.421819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.421794    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.423271 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.423241    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-token" (OuterVolumeSpecName: "istio-token") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:41.423389 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.423276    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-kube-api-access-w6wfs" (OuterVolumeSpecName: "kube-api-access-w6wfs") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "kube-api-access-w6wfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:21:41.423389 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.423292    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:21:41.423511 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.423392    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3707d2b1-ecaa-471e-aca8-b2c6d5133a49" (UID: "3707d2b1-ecaa-471e-aca8-b2c6d5133a49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:21:41.523206 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.523176    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.523206 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.523205    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6wfs\" (UniqueName: \"kubernetes.io/projected/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-kube-api-access-w6wfs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.523473 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.523220    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.523473 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.523231    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:41.523473 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:41.523242    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3707d2b1-ecaa-471e-aca8-b2c6d5133a49-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:21:42.075526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.075486    2573 generic.go:356] "Generic (PLEG): container finished" podID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerID="b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd" exitCode=0
Sep 10 21:21:42.075730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.075554    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"
Sep 10 21:21:42.075730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.075574    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" event={"ID":"3707d2b1-ecaa-471e-aca8-b2c6d5133a49","Type":"ContainerDied","Data":"b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd"}
Sep 10 21:21:42.075730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.075645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn" event={"ID":"3707d2b1-ecaa-471e-aca8-b2c6d5133a49","Type":"ContainerDied","Data":"5ef06eae7482142b3869ce10260aef2ccdb32589a93e13fb37be355a24210350"}
Sep 10 21:21:42.075730 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.075679    2573 scope.go:117] "RemoveContainer" containerID="b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd"
Sep 10 21:21:42.085121 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.085096    2573 scope.go:117] "RemoveContainer" containerID="889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"
Sep 10 21:21:42.094933 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.094908    2573 scope.go:117] "RemoveContainer" containerID="b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd"
Sep 10 21:21:42.095318 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:21:42.095294    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd\": container with ID starting with b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd not found: ID does not exist" containerID="b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd"
Sep 10 21:21:42.095432 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.095327    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd"} err="failed to get container status \"b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd\": rpc error: code = NotFound desc = could not find container \"b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd\": container with ID starting with b4443dfbf9b8c66ad22c2b91c5cf507120d50192b6defb7fd7f5ecb93caebfdd not found: ID does not exist"
Sep 10 21:21:42.095432 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.095346    2573 scope.go:117] "RemoveContainer" containerID="889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"
Sep 10 21:21:42.095546 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.095484    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"]
Sep 10 21:21:42.095597 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:21:42.095584    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d\": container with ID starting with 889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d not found: ID does not exist" containerID="889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"
Sep 10 21:21:42.095635 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.095602    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d"} err="failed to get container status \"889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d\": rpc error: code = NotFound desc = could not find container \"889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d\": container with ID starting with 889b21fc02491085f770f59ac811eb2f2f5af83ad6bff28db664e1da28b6327d not found: ID does not exist"
Sep 10 21:21:42.099244 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:42.099217    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn"]
Sep 10 21:21:44.044144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:44.044110    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" path="/var/lib/kubelet/pods/3707d2b1-ecaa-471e-aca8-b2c6d5133a49/volumes"
Sep 10 21:21:47.859472 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:47.859439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:21:52.466137 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:21:52.466064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:14.979988 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:14.979941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:15.969440 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:15.969388    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:16.372457 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.372423    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:16.649507 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.649419    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"]
Sep 10 21:22:16.649993 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.649977    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe69632-3406-4165-8eb7-936484ee8dda" containerName="maas-api"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.649995    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe69632-3406-4165-8eb7-936484ee8dda" containerName="maas-api"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650004    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" containerName="maas-api"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650010    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" containerName="maas-api"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650022    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650029    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650036    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650041    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650047    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650052    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy"
Sep 10 21:22:16.650058 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650059    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650065    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650071    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2baa7f3-6597-4b56-a24e-677b98de75f4" containerName="maas-api"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650076    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2baa7f3-6597-4b56-a24e-677b98de75f4" containerName="maas-api"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650143    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650154    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650163    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2baa7f3-6597-4b56-a24e-677b98de75f4" containerName="maas-api"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650171    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d71345-dbe6-4b19-98dd-a3ee6c5bdfac" containerName="maas-api"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650180    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe69632-3406-4165-8eb7-936484ee8dda" containerName="maas-api"
Sep 10 21:22:16.650392 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.650186    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3707d2b1-ecaa-471e-aca8-b2c6d5133a49" containerName="istio-proxy"
Sep 10 21:22:16.654942 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.654924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.657499 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.657478    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-3dfe0c-openshift-default-dockercfg-xjq66\""
Sep 10 21:22:16.662944 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.662878    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"]
Sep 10 21:22:16.669825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.669803    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:16.771031 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.770991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:16.778258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istiod-ca-cert\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778454 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778270    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-certs\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778454 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-podinfo\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778454 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-envoy\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-token\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778565    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-data\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778633 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99b2\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-kube-api-access-v99b2\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778780 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-socket\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.778780 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.778675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-credential-socket\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879517 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-envoy\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-token\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-data\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879695 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99b2\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-kube-api-access-v99b2\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-socket\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-credential-socket\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istiod-ca-cert\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.879838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-certs\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.880063 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.879877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-podinfo\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.880063 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.880052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-data\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.880170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.880083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-socket\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.880170 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.880152    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-certs\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.880301 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.880279    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-credential-socket\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.880558 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.880538    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istiod-ca-cert\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.881902 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.881875    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-envoy\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.882390 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.882370    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-podinfo\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.886856 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.886839    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-token\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.887271 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.887250    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99b2\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-kube-api-access-v99b2\") pod \"e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") " pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:16.967541 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:16.967448    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:17.243742 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:17.243716    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"]
Sep 10 21:22:17.245192 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:22:17.245167    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc7efe6_24ae_49cc_aca3_f0063d088c92.slice/crio-e7fb1fe83080c851665d36306a0888f3854299cbe856cb79994f2af6f2ea1926 WatchSource:0}: Error finding container e7fb1fe83080c851665d36306a0888f3854299cbe856cb79994f2af6f2ea1926: Status 404 returned error can't find the container with id e7fb1fe83080c851665d36306a0888f3854299cbe856cb79994f2af6f2ea1926
Sep 10 21:22:17.247518 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:17.247481    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:17.247637 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:17.247547    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:17.247637 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:17.247573    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:17.271872 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:17.271839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" event={"ID":"8fc7efe6-24ae-49cc-aca3-f0063d088c92","Type":"ContainerStarted","Data":"e7fb1fe83080c851665d36306a0888f3854299cbe856cb79994f2af6f2ea1926"}
Sep 10 21:22:18.281934 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:18.281891    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" event={"ID":"8fc7efe6-24ae-49cc-aca3-f0063d088c92","Type":"ContainerStarted","Data":"4b791d7bf025320d73c6ff96fe48e7339f77baaa0e1dd676f425b65548af291b"}
Sep 10 21:22:18.301757 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:18.301706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podStartSLOduration=2.301689074 podStartE2EDuration="2.301689074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:18.300486431 +0000 UTC m=+1460.734316464" watchObservedRunningTime="2026-09-10 21:22:18.301689074 +0000 UTC m=+1460.735519023"
Sep 10 21:22:18.968677 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:18.968640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:18.973838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:18.973811    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:19.288445 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:19.288355    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:19.289328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:19.289310    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:20.150916 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:20.150878    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:20.250493 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:20.250434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:21.288134 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:21.288077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:21.350691 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:21.350640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:21.451374 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:21.451292    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:21.773076 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:21.773036    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:21.881325 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:21.881279    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:29.026498 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:29.026453    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:35.330667 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:35.330594    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:22:35.331124 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:35.330740    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:22:36.382256 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:36.382227    2573 generic.go:356] "Generic (PLEG): container finished" podID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerID="4b791d7bf025320d73c6ff96fe48e7339f77baaa0e1dd676f425b65548af291b" exitCode=0
Sep 10 21:22:36.382725 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:36.382302    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" event={"ID":"8fc7efe6-24ae-49cc-aca3-f0063d088c92","Type":"ContainerDied","Data":"4b791d7bf025320d73c6ff96fe48e7339f77baaa0e1dd676f425b65548af291b"}
Sep 10 21:22:36.382725 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:36.382723    2573 scope.go:117] "RemoveContainer" containerID="4b791d7bf025320d73c6ff96fe48e7339f77baaa0e1dd676f425b65548af291b"
Sep 10 21:22:36.383834 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:36.383807    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:36.383945 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:36.383887    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:36.383945 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:36.383932    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:37.389293 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:37.389256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" event={"ID":"8fc7efe6-24ae-49cc-aca3-f0063d088c92","Type":"ContainerStarted","Data":"d7c7704c482a2b331e552f96c37ae9eab42a8627c4279536d6dbb35921489a96"}
Sep 10 21:22:37.967822 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:37.967782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:37.968008 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:37.967979    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 21:22:37.968054 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:37.968025    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 21:22:38.968122 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:38.968080    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 21:22:38.968563 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:38.968153    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 21:22:39.968252 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:39.968211    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 21:22:39.968680 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:39.968276    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 21:22:40.968340 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:40.968300    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 21:22:40.968752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:40.968359    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 21:22:41.967914 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:41.967871    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 10 21:22:41.968112 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:41.967940    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 10 21:22:42.971762 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:42.971725    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:42.972245 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:42.972072    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:42.972802 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:42.972782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:22:45.868717 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:45.868675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:45.972259 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:45.972224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:46.046817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.046780    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"]
Sep 10 21:22:46.047649 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.047629    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d3c270-00b4-456a-9d42-b3bd5be31d92" containerName="istio-proxy"
Sep 10 21:22:46.050388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.050362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.052806 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.052786    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-636944-openshift-default-dockercfg-6rrzw\""
Sep 10 21:22:46.061217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.061187    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"]
Sep 10 21:22:46.072711 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.072679    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:46.173102 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.173009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:46.189379 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-podinfo\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-envoy\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-credential-socket\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189530 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189501    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istiod-ca-cert\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-token\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sznx4\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-kube-api-access-sznx4\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189627    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-data\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189735 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189690    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-socket\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.189735 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.189711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-certs\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290714 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-token\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290714 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sznx4\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-kube-api-access-sznx4\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-data\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-socket\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-certs\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-podinfo\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.290985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-envoy\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.290992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-credential-socket\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.291041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istiod-ca-cert\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.291183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-data\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.291258    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-socket\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.291294    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-certs\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291509 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.291355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-credential-socket\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.291708 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.291690    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istiod-ca-cert\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.293258 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.293233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-envoy\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.293348 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.293291    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-podinfo\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.303662 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.303634    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sznx4\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-kube-api-access-sznx4\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.304526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.304502    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-token\") pod \"e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") " pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.365294 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.365250    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:46.642315 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.642288    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"]
Sep 10 21:22:46.644104 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:22:46.644073    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5035d92_fd02_4d3b_b717_2fad5cd1da58.slice/crio-eb058316f5150090adfa57b93eb2c4abfe8f18e6d7dfc1b20da3872c401abdbd WatchSource:0}: Error finding container eb058316f5150090adfa57b93eb2c4abfe8f18e6d7dfc1b20da3872c401abdbd: Status 404 returned error can't find the container with id eb058316f5150090adfa57b93eb2c4abfe8f18e6d7dfc1b20da3872c401abdbd
Sep 10 21:22:46.646349 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.646309    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:46.646485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.646389    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:46.646485 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:46.646474    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:22:47.461255 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:47.461217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" event={"ID":"e5035d92-fd02-4d3b-b717-2fad5cd1da58","Type":"ContainerStarted","Data":"aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"}
Sep 10 21:22:47.461655 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:47.461319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" event={"ID":"e5035d92-fd02-4d3b-b717-2fad5cd1da58","Type":"ContainerStarted","Data":"eb058316f5150090adfa57b93eb2c4abfe8f18e6d7dfc1b20da3872c401abdbd"}
Sep 10 21:22:47.481467 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:47.481419    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podStartSLOduration=1.481390158 podStartE2EDuration="1.481390158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:47.479042555 +0000 UTC m=+1489.912872501" watchObservedRunningTime="2026-09-10 21:22:47.481390158 +0000 UTC m=+1489.915220106"
Sep 10 21:22:48.365683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:48.365642    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:48.371240 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:48.371212    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:48.467120 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:48.467082    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:48.468019 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:48.467997    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:22:49.332726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:49.332690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:49.432900 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:49.432855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:50.493708 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:50.493676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:50.600654 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:50.600605    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:50.694579 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:50.694541    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:50.966503 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:50.966470    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:51.058201 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:51.058163    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:22:58.132391 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:58.132362    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:22:58.138179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:22:58.138151    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:23:07.578740 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:07.578709    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerID="aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4" exitCode=0
Sep 10 21:23:07.579263 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:07.578758    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" event={"ID":"e5035d92-fd02-4d3b-b717-2fad5cd1da58","Type":"ContainerDied","Data":"aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"}
Sep 10 21:23:07.579329 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:07.579288    2573 scope.go:117] "RemoveContainer" containerID="aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"
Sep 10 21:23:07.580516 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:07.580488    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:23:07.580590 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:07.580563    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:23:07.580629 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:07.580602    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:23:08.585628 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:08.585593    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" event={"ID":"e5035d92-fd02-4d3b-b717-2fad5cd1da58","Type":"ContainerStarted","Data":"c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a"}
Sep 10 21:23:09.365602 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:09.365562    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:23:09.365801 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:09.365768    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:23:09.365849 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:09.365822    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:23:10.366046 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:10.366003    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:23:10.366453 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:10.366060    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:23:11.366451 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:11.366390    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:23:11.366839 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:11.366482    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:23:12.365737 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:12.365697    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:23:12.365922 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:12.365769    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:23:13.365914 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:13.365882    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:23:13.366312 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:13.365942    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:23:14.279960 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:14.279926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:23:14.370573 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:14.370545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:23:14.370973 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:14.370819    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:23:14.371660 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:14.371640    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:23:40.797126 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:23:40.797087    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:05.524794 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.524757    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:05.794676 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.794583    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"]
Sep 10 21:24:05.802279 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.799214    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.802279 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.802003    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-361296-openshift-default-dockercfg-qdrjc\""
Sep 10 21:24:05.811707 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.811681    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"]
Sep 10 21:24:05.845243 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.845209    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:05.938735 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.938695    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-credential-socket\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.938735 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.938739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-token\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939016 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.938832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-envoy\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939016 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.938854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-certs\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939016 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.938893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-data\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939016 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.938961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc709b02-dc52-4fc3-ab95-daad71b99e88-istiod-ca-cert\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.939063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-podinfo\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.939097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z86mj\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-kube-api-access-z86mj\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.939234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.939128    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-socket\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:05.979279 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:05.979247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:06.040454 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-envoy\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-certs\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-data\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc709b02-dc52-4fc3-ab95-daad71b99e88-istiod-ca-cert\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040652 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-podinfo\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040663    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z86mj\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-kube-api-access-z86mj\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040898    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-certs\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.040943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.040916    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-data\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.041097 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.041052    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-socket\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.041212 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.041184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-credential-socket\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.041352 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.041237    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-socket\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.041352 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.041264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-token\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.041523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.041347    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc709b02-dc52-4fc3-ab95-daad71b99e88-istiod-ca-cert\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.041523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.041465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-credential-socket\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.043147 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.043119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-envoy\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.043243 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.043174    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-podinfo\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.048574 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.048512    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z86mj\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-kube-api-access-z86mj\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.048574 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.048557    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-token\") pod \"e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") " pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.115331 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.115294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:06.391589 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.391553    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"]
Sep 10 21:24:06.391957 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:24:06.391931    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc709b02_dc52_4fc3_ab95_daad71b99e88.slice/crio-682697a2bf02b8264097b7f46a1f4de157b42d30d3050723a4cb8996f280e63e WatchSource:0}: Error finding container 682697a2bf02b8264097b7f46a1f4de157b42d30d3050723a4cb8996f280e63e: Status 404 returned error can't find the container with id 682697a2bf02b8264097b7f46a1f4de157b42d30d3050723a4cb8996f280e63e
Sep 10 21:24:06.394442 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.394381    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:24:06.394551 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.394472    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:24:06.394551 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.394506    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:24:06.924436 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.924388    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" event={"ID":"cc709b02-dc52-4fc3-ab95-daad71b99e88","Type":"ContainerStarted","Data":"c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"}
Sep 10 21:24:06.924831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.924483    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" event={"ID":"cc709b02-dc52-4fc3-ab95-daad71b99e88","Type":"ContainerStarted","Data":"682697a2bf02b8264097b7f46a1f4de157b42d30d3050723a4cb8996f280e63e"}
Sep 10 21:24:06.945988 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:06.945928    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podStartSLOduration=1.945906558 podStartE2EDuration="1.945906558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:24:06.943645046 +0000 UTC m=+1569.377475011" watchObservedRunningTime="2026-09-10 21:24:06.945906558 +0000 UTC m=+1569.379736577"
Sep 10 21:24:07.115656 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:07.115607    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:07.121540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:07.121510    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:07.930900 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:07.930869    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:07.931995 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:07.931977    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:08.829811 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:08.829762    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:08.922726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:08.922693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:10.004322 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:10.004288    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:10.101413 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:10.101376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:10.473290 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:10.473257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:10.557611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:10.557571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:24.733907 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:24.733870    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:24.783787 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:24.783732    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:30.066446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:30.066323    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerID="c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4" exitCode=0
Sep 10 21:24:30.066446 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:30.066387    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" event={"ID":"cc709b02-dc52-4fc3-ab95-daad71b99e88","Type":"ContainerDied","Data":"c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"}
Sep 10 21:24:30.066883 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:30.066852    2573 scope.go:117] "RemoveContainer" containerID="c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"
Sep 10 21:24:30.068135 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:30.068092    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:24:30.068208 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:30.068176    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:24:30.068246 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:30.068208    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 21:24:31.074782 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:31.074748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" event={"ID":"cc709b02-dc52-4fc3-ab95-daad71b99e88","Type":"ContainerStarted","Data":"780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84"}
Sep 10 21:24:31.115724 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:31.115673    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:31.116056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:31.116020    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:24:31.116148 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:31.116086    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:24:32.116457 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:32.116393    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:24:32.116964 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:32.116489    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:24:33.116557 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:33.116516    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:24:33.117092 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:33.116591    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:24:33.771753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:33.771712    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:34.116641 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:34.116597    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:24:34.117151 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:34.116675    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:24:35.116478 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:35.116434    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:24:35.116698 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:35.116516    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:24:36.118390 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:36.118349    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:24:36.119149 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:36.119108    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:24:37.119890 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:37.119863    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:37.120307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:37.120125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:37.120784 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:37.120764    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:40.472527 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:40.472498    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:40.539116 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:40.539077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:40.637428 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:40.637371    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:40.692309 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:40.692280    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:41.009819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:41.009777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:46.654254 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:46.654216    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:46.711526 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:46.711491    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:46.889712 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:46.889674    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"]
Sep 10 21:24:46.890030 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:46.889992    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" containerID="cri-o://780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84" gracePeriod=30
Sep 10 21:24:46.903906 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:46.903877    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:50.487708 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:50.487622    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:51.149593 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:51.149562    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:51.780693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:51.780654    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:24:52.162176 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.162150    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:52.208422 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.208363    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerID="780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84" exitCode=0
Sep 10 21:24:52.208640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.208437    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" event={"ID":"cc709b02-dc52-4fc3-ab95-daad71b99e88","Type":"ContainerDied","Data":"780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84"}
Sep 10 21:24:52.208640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.208458    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"
Sep 10 21:24:52.208640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.208515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" event={"ID":"cc709b02-dc52-4fc3-ab95-daad71b99e88","Type":"ContainerDied","Data":"682697a2bf02b8264097b7f46a1f4de157b42d30d3050723a4cb8996f280e63e"}
Sep 10 21:24:52.208640 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.208600    2573 scope.go:117] "RemoveContainer" containerID="780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84"
Sep 10 21:24:52.219491 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.219463    2573 scope.go:117] "RemoveContainer" containerID="c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"
Sep 10 21:24:52.229127 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.229108    2573 scope.go:117] "RemoveContainer" containerID="780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84"
Sep 10 21:24:52.229465 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:24:52.229446    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84\": container with ID starting with 780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84 not found: ID does not exist" containerID="780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84"
Sep 10 21:24:52.229550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.229477    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84"} err="failed to get container status \"780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84\": rpc error: code = NotFound desc = could not find container \"780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84\": container with ID starting with 780f71388f7429a09c5904c9027c4cf6bf7bcaac3f272dbfe2c5e8777b7b0f84 not found: ID does not exist"
Sep 10 21:24:52.229550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.229502    2573 scope.go:117] "RemoveContainer" containerID="c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"
Sep 10 21:24:52.229804 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:24:52.229785    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4\": container with ID starting with c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4 not found: ID does not exist" containerID="c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"
Sep 10 21:24:52.229864 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.229812    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4"} err="failed to get container status \"c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4\": rpc error: code = NotFound desc = could not find container \"c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4\": container with ID starting with c41e380b6cf4695fc0725b4190282c5ad08bb93ce7e11821e49a1f629a68b6d4 not found: ID does not exist"
Sep 10 21:24:52.243867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.243837    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-certs\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244028 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.243899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z86mj\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-kube-api-access-z86mj\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244028 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.243984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-envoy\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244036    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-credential-socket\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-socket\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244101    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc709b02-dc52-4fc3-ab95-daad71b99e88-istiod-ca-cert\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244126    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-data\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244130    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:52.244477 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244157    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-podinfo\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244477 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244191    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-token\") pod \"cc709b02-dc52-4fc3-ab95-daad71b99e88\" (UID: \"cc709b02-dc52-4fc3-ab95-daad71b99e88\") "
Sep 10 21:24:52.244477 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244366    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:52.244645 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244394    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:52.244645 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244579    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc709b02-dc52-4fc3-ab95-daad71b99e88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:24:52.244751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244634    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:52.244751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244662    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.244751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244677    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.244751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.244689    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.246926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.246901    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:24:52.247046 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.246921    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:24:52.247046 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.246977    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:52.247046 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.247008    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-kube-api-access-z86mj" (OuterVolumeSpecName: "kube-api-access-z86mj") pod "cc709b02-dc52-4fc3-ab95-daad71b99e88" (UID: "cc709b02-dc52-4fc3-ab95-daad71b99e88"). InnerVolumeSpecName "kube-api-access-z86mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:24:52.345500 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.345463    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z86mj\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-kube-api-access-z86mj\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.345500 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.345496    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.345500 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.345505    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc709b02-dc52-4fc3-ab95-daad71b99e88-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.345755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.345514    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc709b02-dc52-4fc3-ab95-daad71b99e88-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.345755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.345523    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.345755 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.345531    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc709b02-dc52-4fc3-ab95-daad71b99e88-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:24:52.533947 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.533916    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"]
Sep 10 21:24:52.536282 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:52.536257    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78"]
Sep 10 21:24:53.121829 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:53.121788    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:24:53.122308 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:53.121854    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:24:54.044287 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:24:54.044242    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" path="/var/lib/kubelet/pods/cc709b02-dc52-4fc3-ab95-daad71b99e88/volumes"
Sep 10 21:25:05.892064 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:05.892022    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:05.956376 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:05.956324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:06.011969 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:06.011934    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:06.078872 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:06.078839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:06.137052 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:06.137024    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:06.434860 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:06.434825    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:11.510907 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:11.510874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:19.391313 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:19.391276    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:48.116630 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:48.116595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:48.462223 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:48.462124    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:52.210360 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:52.210329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:52.264127 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:52.264092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.112253 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:54.112211    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.213056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:54.213020    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.345232 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:54.345193    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"]
Sep 10 21:25:54.345525 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:54.345495    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" containerID="cri-o://d7c7704c482a2b331e552f96c37ae9eab42a8627c4279536d6dbb35921489a96" gracePeriod=30
Sep 10 21:25:54.366143 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:54.366046    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:54.903066 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:54.903030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:25:57.975182 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:57.975148    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:25:57.975586 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:57.975216    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:25:59.594645 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.594615    2573 generic.go:356] "Generic (PLEG): container finished" podID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerID="d7c7704c482a2b331e552f96c37ae9eab42a8627c4279536d6dbb35921489a96" exitCode=0
Sep 10 21:25:59.595060 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.594688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" event={"ID":"8fc7efe6-24ae-49cc-aca3-f0063d088c92","Type":"ContainerDied","Data":"d7c7704c482a2b331e552f96c37ae9eab42a8627c4279536d6dbb35921489a96"}
Sep 10 21:25:59.595060 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.594752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn" event={"ID":"8fc7efe6-24ae-49cc-aca3-f0063d088c92","Type":"ContainerDied","Data":"e7fb1fe83080c851665d36306a0888f3854299cbe856cb79994f2af6f2ea1926"}
Sep 10 21:25:59.595060 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.594774    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7fb1fe83080c851665d36306a0888f3854299cbe856cb79994f2af6f2ea1926"
Sep 10 21:25:59.595060 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.594790    2573 scope.go:117] "RemoveContainer" containerID="4b791d7bf025320d73c6ff96fe48e7339f77baaa0e1dd676f425b65548af291b"
Sep 10 21:25:59.610523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.610499    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:25:59.639216 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639184    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-envoy\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639438 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639243    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v99b2\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-kube-api-access-v99b2\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639438 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639272    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-podinfo\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639438 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639301    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-data\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639438 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639341    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-socket\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639534    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-certs\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639599    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istiod-ca-cert\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639693 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639641    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-credential-socket\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639699    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:59.639867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639738    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-token\") pod \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\" (UID: \"8fc7efe6-24ae-49cc-aca3-f0063d088c92\") "
Sep 10 21:25:59.639867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639804    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:59.640037 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.639958    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:59.640124 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:59.640179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640160    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:59.640264 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640244    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.640328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640269    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.640328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640284    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.640328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640297    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.640328 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.640309    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.641779 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.641755    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:25:59.642111 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.642090    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-kube-api-access-v99b2" (OuterVolumeSpecName: "kube-api-access-v99b2") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "kube-api-access-v99b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:59.642111 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.642097    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:25:59.642273 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.642257    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fc7efe6-24ae-49cc-aca3-f0063d088c92" (UID: "8fc7efe6-24ae-49cc-aca3-f0063d088c92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:59.741596 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.741555    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.741596 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.741587    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.741596 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.741598    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v99b2\" (UniqueName: \"kubernetes.io/projected/8fc7efe6-24ae-49cc-aca3-f0063d088c92-kube-api-access-v99b2\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:25:59.741596 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:25:59.741608    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fc7efe6-24ae-49cc-aca3-f0063d088c92-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:00.602544 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:00.602513    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"
Sep 10 21:26:00.634270 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:00.634236    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"]
Sep 10 21:26:00.637813 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:00.637786    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn"]
Sep 10 21:26:02.042926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:02.042892    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" path="/var/lib/kubelet/pods/8fc7efe6-24ae-49cc-aca3-f0063d088c92/volumes"
Sep 10 21:26:05.259419 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:05.259074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:05.339345 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:05.339307    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:05.400604 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:05.400571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:05.462038 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:05.461986    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:05.522931 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:05.522831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:05.832292 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:05.832260    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:11.535849 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:11.535812    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:11.631600 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:11.631563    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:11.755429 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:11.755380    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"]
Sep 10 21:26:11.755651 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:11.755624    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" containerID="cri-o://c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a" gracePeriod=30
Sep 10 21:26:11.771630 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:11.771595    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:12.222966 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:12.222927    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:14.373496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:14.373458    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:26:14.373907 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:14.373532    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:26:17.013724 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.013695    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:26:17.121122 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121088    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-envoy\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121122 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121130    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-credential-socket\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-token\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121255    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-socket\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121279    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-data\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121314    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istiod-ca-cert\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121394 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121378    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-certs\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121427    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-podinfo\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121490    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sznx4\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-kube-api-access-sznx4\") pod \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\" (UID: \"e5035d92-fd02-4d3b-b717-2fad5cd1da58\") "
Sep 10 21:26:17.121671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121506    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:17.121671 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121585    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:17.121976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121719    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:17.121976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121751    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:17.121976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121578    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:17.121976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121934    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.121976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121952    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.121976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121966    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.122291 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121980    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.122291 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.121993    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.123692 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.123666    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-kube-api-access-sznx4" (OuterVolumeSpecName: "kube-api-access-sznx4") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "kube-api-access-sznx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:17.123692 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.123685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:26:17.123869 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.123848    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:17.123920 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.123858    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5035d92-fd02-4d3b-b717-2fad5cd1da58" (UID: "e5035d92-fd02-4d3b-b717-2fad5cd1da58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:17.222726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.222691    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.222726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.222718    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sznx4\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-kube-api-access-sznx4\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.222726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.222728    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.222726 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.222737    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5035d92-fd02-4d3b-b717-2fad5cd1da58-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:17.704153 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.704114    2573 generic.go:356] "Generic (PLEG): container finished" podID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerID="c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a" exitCode=0
Sep 10 21:26:17.704375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.704171    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"
Sep 10 21:26:17.704375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.704196    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" event={"ID":"e5035d92-fd02-4d3b-b717-2fad5cd1da58","Type":"ContainerDied","Data":"c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a"}
Sep 10 21:26:17.704375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.704265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg" event={"ID":"e5035d92-fd02-4d3b-b717-2fad5cd1da58","Type":"ContainerDied","Data":"eb058316f5150090adfa57b93eb2c4abfe8f18e6d7dfc1b20da3872c401abdbd"}
Sep 10 21:26:17.704375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.704298    2573 scope.go:117] "RemoveContainer" containerID="c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a"
Sep 10 21:26:17.715179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.715161    2573 scope.go:117] "RemoveContainer" containerID="aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"
Sep 10 21:26:17.724790 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.724766    2573 scope.go:117] "RemoveContainer" containerID="c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a"
Sep 10 21:26:17.725177 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:26:17.725134    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a\": container with ID starting with c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a not found: ID does not exist" containerID="c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a"
Sep 10 21:26:17.725252 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.725189    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a"} err="failed to get container status \"c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a\": rpc error: code = NotFound desc = could not find container \"c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a\": container with ID starting with c3d4c3721ea23095d9bde15998373db54deefe8f48090ecd45d6e35d098a638a not found: ID does not exist"
Sep 10 21:26:17.725252 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.725210    2573 scope.go:117] "RemoveContainer" containerID="aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"
Sep 10 21:26:17.725526 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:26:17.725505    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4\": container with ID starting with aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4 not found: ID does not exist" containerID="aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"
Sep 10 21:26:17.725601 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.725531    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4"} err="failed to get container status \"aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4\": rpc error: code = NotFound desc = could not find container \"aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4\": container with ID starting with aabfeb0ce8692d7272199005e73f5023b373b9d38f854c97597c253f334c71b4 not found: ID does not exist"
Sep 10 21:26:17.726964 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.726910    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"]
Sep 10 21:26:17.729836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:17.729812    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg"]
Sep 10 21:26:18.043149 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:18.043052    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" path="/var/lib/kubelet/pods/e5035d92-fd02-4d3b-b717-2fad5cd1da58/volumes"
Sep 10 21:26:22.556272 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.556164    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"]
Sep 10 21:26:22.556794 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.556454    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" podUID="3e89ab0b-94f1-43fd-9b97-8e03c8d18459" containerName="maas-api" containerID="cri-o://72691321f3f6dfe4b9a1cc444cd55dcd1809713f23dc01f2fc5e90d9cc46ec9b" gracePeriod=30
Sep 10 21:26:22.583534 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.583500    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:22.666055 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.666016    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:22.724880 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.724829    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:22.745631 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.745599    2573 generic.go:356] "Generic (PLEG): container finished" podID="3e89ab0b-94f1-43fd-9b97-8e03c8d18459" containerID="72691321f3f6dfe4b9a1cc444cd55dcd1809713f23dc01f2fc5e90d9cc46ec9b" exitCode=0
Sep 10 21:26:22.745950 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.745681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" event={"ID":"3e89ab0b-94f1-43fd-9b97-8e03c8d18459","Type":"ContainerDied","Data":"72691321f3f6dfe4b9a1cc444cd55dcd1809713f23dc01f2fc5e90d9cc46ec9b"}
Sep 10 21:26:22.785877 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.785841    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:22.814303 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.814237    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:26:22.983226 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.983193    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-openshift-service-ca\") pod \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") "
Sep 10 21:26:22.983461 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.983293    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls\") pod \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") "
Sep 10 21:26:22.983461 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.983316    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-metrics-certs\") pod \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") "
Sep 10 21:26:22.983461 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.983373    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz9n8\" (UniqueName: \"kubernetes.io/projected/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-kube-api-access-hz9n8\") pod \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\" (UID: \"3e89ab0b-94f1-43fd-9b97-8e03c8d18459\") "
Sep 10 21:26:22.983683 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.983653    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e89ab0b-94f1-43fd-9b97-8e03c8d18459" (UID: "3e89ab0b-94f1-43fd-9b97-8e03c8d18459"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:22.985658 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.985621    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e89ab0b-94f1-43fd-9b97-8e03c8d18459" (UID: "3e89ab0b-94f1-43fd-9b97-8e03c8d18459"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:22.985658 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.985617    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-kube-api-access-hz9n8" (OuterVolumeSpecName: "kube-api-access-hz9n8") pod "3e89ab0b-94f1-43fd-9b97-8e03c8d18459" (UID: "3e89ab0b-94f1-43fd-9b97-8e03c8d18459"). InnerVolumeSpecName "kube-api-access-hz9n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:22.985817 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:22.985753    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3e89ab0b-94f1-43fd-9b97-8e03c8d18459" (UID: "3e89ab0b-94f1-43fd-9b97-8e03c8d18459"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:23.084950 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.084914    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:23.084950 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.084948    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:23.084950 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.084958    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:23.085198 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.084966    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz9n8\" (UniqueName: \"kubernetes.io/projected/3e89ab0b-94f1-43fd-9b97-8e03c8d18459-kube-api-access-hz9n8\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:23.134093 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.134056    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:23.752991 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.752954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h" event={"ID":"3e89ab0b-94f1-43fd-9b97-8e03c8d18459","Type":"ContainerDied","Data":"b87bc002dd98a2cec58b3fe4ff7a190e307fb413f9abfd369212eebd7a100787"}
Sep 10 21:26:23.752991 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.752990    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"
Sep 10 21:26:23.753590 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.753016    2573 scope.go:117] "RemoveContainer" containerID="72691321f3f6dfe4b9a1cc444cd55dcd1809713f23dc01f2fc5e90d9cc46ec9b"
Sep 10 21:26:23.774540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.774506    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"]
Sep 10 21:26:23.778298 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:23.778257    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-8623b2-7b4f677b6-cgq5h"]
Sep 10 21:26:24.043540 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:24.043446    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e89ab0b-94f1-43fd-9b97-8e03c8d18459" path="/var/lib/kubelet/pods/3e89ab0b-94f1-43fd-9b97-8e03c8d18459/volumes"
Sep 10 21:26:29.044806 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:29.044770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:29.145016 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:29.144975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:29.292467 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:29.292387    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:29.780538 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:29.780501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:32.686531 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:32.686497    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:34.927918 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:34.927879    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:40.053297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.053262    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"]
Sep 10 21:26:40.054101 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.054068    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" podUID="4421fdbb-60d4-46e8-8df3-b19bdce90d50" containerName="maas-api" containerID="cri-o://81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b" gracePeriod=30
Sep 10 21:26:40.081237 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.081206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:40.181819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.181781    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:40.277689 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.277645    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:40.318645 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.318619    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:26:40.343653 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.343623    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:40.456583 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.456543    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4421fdbb-60d4-46e8-8df3-b19bdce90d50-openshift-service-ca\") pod \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") "
Sep 10 21:26:40.456772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.456621    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-metrics-certs\") pod \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") "
Sep 10 21:26:40.456772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.456684    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls\") pod \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") "
Sep 10 21:26:40.456772 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.456720    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jbf4\" (UniqueName: \"kubernetes.io/projected/4421fdbb-60d4-46e8-8df3-b19bdce90d50-kube-api-access-4jbf4\") pod \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\" (UID: \"4421fdbb-60d4-46e8-8df3-b19bdce90d50\") "
Sep 10 21:26:40.457010 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.456984    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4421fdbb-60d4-46e8-8df3-b19bdce90d50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4421fdbb-60d4-46e8-8df3-b19bdce90d50" (UID: "4421fdbb-60d4-46e8-8df3-b19bdce90d50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:40.457205 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.457186    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4421fdbb-60d4-46e8-8df3-b19bdce90d50-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:40.459158 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.459083    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4421fdbb-60d4-46e8-8df3-b19bdce90d50-kube-api-access-4jbf4" (OuterVolumeSpecName: "kube-api-access-4jbf4") pod "4421fdbb-60d4-46e8-8df3-b19bdce90d50" (UID: "4421fdbb-60d4-46e8-8df3-b19bdce90d50"). InnerVolumeSpecName "kube-api-access-4jbf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:40.459388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.459356    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4421fdbb-60d4-46e8-8df3-b19bdce90d50" (UID: "4421fdbb-60d4-46e8-8df3-b19bdce90d50"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:40.459514 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.459377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4421fdbb-60d4-46e8-8df3-b19bdce90d50" (UID: "4421fdbb-60d4-46e8-8df3-b19bdce90d50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:40.558753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.558708    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:40.558753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.558744    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4421fdbb-60d4-46e8-8df3-b19bdce90d50-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:40.558753 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.558753    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jbf4\" (UniqueName: \"kubernetes.io/projected/4421fdbb-60d4-46e8-8df3-b19bdce90d50-kube-api-access-4jbf4\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:40.633361 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.633261    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:40.849995 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.849957    2573 generic.go:356] "Generic (PLEG): container finished" podID="4421fdbb-60d4-46e8-8df3-b19bdce90d50" containerID="81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b" exitCode=0
Sep 10 21:26:40.850179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.850005    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"
Sep 10 21:26:40.850179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.850044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" event={"ID":"4421fdbb-60d4-46e8-8df3-b19bdce90d50","Type":"ContainerDied","Data":"81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b"}
Sep 10 21:26:40.850179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.850106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg" event={"ID":"4421fdbb-60d4-46e8-8df3-b19bdce90d50","Type":"ContainerDied","Data":"54d0871c06bc94ec8d4f2ff5fba510ca1123b5b550a2ea915e0882bc3b61f372"}
Sep 10 21:26:40.850179 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.850132    2573 scope.go:117] "RemoveContainer" containerID="81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b"
Sep 10 21:26:40.860297 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.860273    2573 scope.go:117] "RemoveContainer" containerID="81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b"
Sep 10 21:26:40.860650 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:26:40.860630    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b\": container with ID starting with 81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b not found: ID does not exist" containerID="81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b"
Sep 10 21:26:40.860729 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.860661    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b"} err="failed to get container status \"81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b\": rpc error: code = NotFound desc = could not find container \"81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b\": container with ID starting with 81dc0cb8b274b7a09f80d2abe2335aa4f1099b4ccf0fd9aab722fee137e2615b not found: ID does not exist"
Sep 10 21:26:40.874128 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.874077    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"]
Sep 10 21:26:40.879475 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:40.879441    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4eb314-7bd5cc9869-t27wg"]
Sep 10 21:26:42.047219 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:42.047182    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4421fdbb-60d4-46e8-8df3-b19bdce90d50" path="/var/lib/kubelet/pods/4421fdbb-60d4-46e8-8df3-b19bdce90d50/volumes"
Sep 10 21:26:46.396265 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:46.396227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:46.495196 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:46.495156    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:46.611987 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:46.611954    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"]
Sep 10 21:26:46.612286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:46.612256    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" containerID="cri-o://07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582" gracePeriod=30
Sep 10 21:26:46.638835 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:46.638794    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:48.354719 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:48.354677    2573 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:26:48.355103 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:48.354743    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:26:48.518024 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:48.517991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:26:49.116452 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.116394    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-sfpdz"]
Sep 10 21:26:49.116714 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.116649    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz" podUID="2d370068-ee55-4386-9488-332442c5b706" containerName="manager" containerID="cri-o://9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048" gracePeriod=30
Sep 10 21:26:49.379891 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.379823    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:26:49.454313 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.454271    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-metrics-certs\") pod \"2d370068-ee55-4386-9488-332442c5b706\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") "
Sep 10 21:26:49.454535 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.454353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-webhook-cert\") pod \"2d370068-ee55-4386-9488-332442c5b706\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") "
Sep 10 21:26:49.454535 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.454466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcdmp\" (UniqueName: \"kubernetes.io/projected/2d370068-ee55-4386-9488-332442c5b706-kube-api-access-gcdmp\") pod \"2d370068-ee55-4386-9488-332442c5b706\" (UID: \"2d370068-ee55-4386-9488-332442c5b706\") "
Sep 10 21:26:49.456534 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.456506    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2d370068-ee55-4386-9488-332442c5b706" (UID: "2d370068-ee55-4386-9488-332442c5b706"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:49.456688 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.456635    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d370068-ee55-4386-9488-332442c5b706-kube-api-access-gcdmp" (OuterVolumeSpecName: "kube-api-access-gcdmp") pod "2d370068-ee55-4386-9488-332442c5b706" (UID: "2d370068-ee55-4386-9488-332442c5b706"). InnerVolumeSpecName "kube-api-access-gcdmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:49.456762 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.456747    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2d370068-ee55-4386-9488-332442c5b706" (UID: "2d370068-ee55-4386-9488-332442c5b706"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:26:49.555619 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.555578    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-webhook-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:49.555619 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.555614    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcdmp\" (UniqueName: \"kubernetes.io/projected/2d370068-ee55-4386-9488-332442c5b706-kube-api-access-gcdmp\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:49.555619 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.555627    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d370068-ee55-4386-9488-332442c5b706-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:49.906523 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.906477    2573 generic.go:356] "Generic (PLEG): container finished" podID="2d370068-ee55-4386-9488-332442c5b706" containerID="9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048" exitCode=0
Sep 10 21:26:49.906819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.906530    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz"
Sep 10 21:26:49.906819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.906562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz" event={"ID":"2d370068-ee55-4386-9488-332442c5b706","Type":"ContainerDied","Data":"9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048"}
Sep 10 21:26:49.906819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.906633    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-sfpdz" event={"ID":"2d370068-ee55-4386-9488-332442c5b706","Type":"ContainerDied","Data":"e2e9393c4d4f98c0f9bbcf92d932e1cef9626fee782fb5d1b146a1b0c4f44368"}
Sep 10 21:26:49.906819 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.906679    2573 scope.go:117] "RemoveContainer" containerID="9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048"
Sep 10 21:26:49.917379 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.917361    2573 scope.go:117] "RemoveContainer" containerID="9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048"
Sep 10 21:26:49.917767 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:26:49.917741    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048\": container with ID starting with 9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048 not found: ID does not exist" containerID="9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048"
Sep 10 21:26:49.917853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.917781    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048"} err="failed to get container status \"9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048\": rpc error: code = NotFound desc = could not find container \"9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048\": container with ID starting with 9c9878374521278d363a69862d960b4db3054e67aa8ad61154a5d648f7934048 not found: ID does not exist"
Sep 10 21:26:49.928484 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.928451    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-sfpdz"]
Sep 10 21:26:49.931967 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:49.931936    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-sfpdz"]
Sep 10 21:26:50.043235 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:50.043201    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d370068-ee55-4386-9488-332442c5b706" path="/var/lib/kubelet/pods/2d370068-ee55-4386-9488-332442c5b706/volumes"
Sep 10 21:26:51.864337 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.864311    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:26:51.928522 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.928435    2573 generic.go:356] "Generic (PLEG): container finished" podID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerID="07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582" exitCode=0
Sep 10 21:26:51.928522 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.928484    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"
Sep 10 21:26:51.928522 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.928506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" event={"ID":"bc774f30-97e6-4c81-b621-4e5bc7b51955","Type":"ContainerDied","Data":"07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582"}
Sep 10 21:26:51.928754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.928583    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4" event={"ID":"bc774f30-97e6-4c81-b621-4e5bc7b51955","Type":"ContainerDied","Data":"856e5ee2027775da1d7758451ee9769d3b87fdc027d0df51289ab5bf5f1df199"}
Sep 10 21:26:51.928754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.928608    2573 scope.go:117] "RemoveContainer" containerID="07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582"
Sep 10 21:26:51.937678 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.937659    2573 scope.go:117] "RemoveContainer" containerID="32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"
Sep 10 21:26:51.945623 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.945604    2573 scope.go:117] "RemoveContainer" containerID="07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582"
Sep 10 21:26:51.945933 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:26:51.945910    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582\": container with ID starting with 07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582 not found: ID does not exist" containerID="07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582"
Sep 10 21:26:51.946034 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.945940    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582"} err="failed to get container status \"07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582\": rpc error: code = NotFound desc = could not find container \"07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582\": container with ID starting with 07e6a0602e95ff8db1d98dbf77bef7310e1f8172ee90258ffee1456b08b3e582 not found: ID does not exist"
Sep 10 21:26:51.946034 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.945959    2573 scope.go:117] "RemoveContainer" containerID="32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"
Sep 10 21:26:51.946252 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:26:51.946232    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c\": container with ID starting with 32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c not found: ID does not exist" containerID="32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"
Sep 10 21:26:51.946301 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.946259    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c"} err="failed to get container status \"32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c\": rpc error: code = NotFound desc = could not find container \"32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c\": container with ID starting with 32dd799a65adc8868dd0c8bd9538717f1b3c51945efb50731a22229aa3c7962c not found: ID does not exist"
Sep 10 21:26:51.979712 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.979678    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-certs\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.979876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.979728    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-podinfo\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.979876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.979765    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc774f30-97e6-4c81-b621-4e5bc7b51955-istiod-ca-cert\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.979876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.979787    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-token\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.979876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.979825    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj6rx\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-kube-api-access-lj6rx\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.979876 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.979862    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-socket\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.980144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980013    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-envoy\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.980144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980017    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:51.980144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-credential-socket\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.980144 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980094    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-data\") pod \"bc774f30-97e6-4c81-b621-4e5bc7b51955\" (UID: \"bc774f30-97e6-4c81-b621-4e5bc7b51955\") "
Sep 10 21:26:51.980356 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980161    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:51.980356 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980329    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc774f30-97e6-4c81-b621-4e5bc7b51955-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:51.980356 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980333    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:51.980548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980442    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:51.980725 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980702    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:51.980890 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980875    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc774f30-97e6-4c81-b621-4e5bc7b51955-istiod-ca-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:51.981015 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.980993    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-workload-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:51.981015 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.981017    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-credential-socket\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:51.981015 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.981032    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-data\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:51.982271 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.982215    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:51.982271 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.982228    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:26:51.982462 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.982314    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:26:51.982462 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:51.982315    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-kube-api-access-lj6rx" (OuterVolumeSpecName: "kube-api-access-lj6rx") pod "bc774f30-97e6-4c81-b621-4e5bc7b51955" (UID: "bc774f30-97e6-4c81-b621-4e5bc7b51955"). InnerVolumeSpecName "kube-api-access-lj6rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:26:52.082113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:52.082078    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-podinfo\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:52.082113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:52.082104    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-token\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:52.082113 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:52.082114    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj6rx\" (UniqueName: \"kubernetes.io/projected/bc774f30-97e6-4c81-b621-4e5bc7b51955-kube-api-access-lj6rx\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:52.082347 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:52.082125    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc774f30-97e6-4c81-b621-4e5bc7b51955-istio-envoy\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:26:52.244391 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:52.244306    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"]
Sep 10 21:26:52.248071 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:52.248038    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4"]
Sep 10 21:26:54.043414 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:26:54.043375    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" path="/var/lib/kubelet/pods/bc774f30-97e6-4c81-b621-4e5bc7b51955/volumes"
Sep 10 21:27:50.706548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.706460    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-g94hz"]
Sep 10 21:27:50.707329 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707297    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4421fdbb-60d4-46e8-8df3-b19bdce90d50" containerName="maas-api"
Sep 10 21:27:50.707329 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707321    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4421fdbb-60d4-46e8-8df3-b19bdce90d50" containerName="maas-api"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707337    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707347    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707357    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707366    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707381    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e89ab0b-94f1-43fd-9b97-8e03c8d18459" containerName="maas-api"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707389    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e89ab0b-94f1-43fd-9b97-8e03c8d18459" containerName="maas-api"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707414    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707424    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707449    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707457    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707467    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707474    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707487    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707494    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707508    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d370068-ee55-4386-9488-332442c5b706" containerName="manager"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707516    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d370068-ee55-4386-9488-332442c5b706" containerName="manager"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707529    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707537    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707547    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy"
Sep 10 21:27:50.707560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707555    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707695    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d370068-ee55-4386-9488-332442c5b706" containerName="manager"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707707    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707715    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707724    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707734    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e89ab0b-94f1-43fd-9b97-8e03c8d18459" containerName="maas-api"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707744    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5035d92-fd02-4d3b-b717-2fad5cd1da58" containerName="istio-proxy"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707754    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707762    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4421fdbb-60d4-46e8-8df3-b19bdce90d50" containerName="maas-api"
Sep 10 21:27:50.708610 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.707771    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc7efe6-24ae-49cc-aca3-f0063d088c92" containerName="istio-proxy"
Sep 10 21:27:50.711481 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.711459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.713970 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.713950    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:27:50.714768 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.714750    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq4km\""
Sep 10 21:27:50.714891 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.714866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:27:50.714985 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.714925    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:27:50.720044 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.720020    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-g94hz"]
Sep 10 21:27:50.736926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.736880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-metrics-certs\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.736926 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.736923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddjq\" (UniqueName: \"kubernetes.io/projected/9c01cda0-1424-42c3-be61-ac4204717079-kube-api-access-wddjq\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.737184 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.736942    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-webhook-cert\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.838482 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.838433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-metrics-certs\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.838482 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.838484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddjq\" (UniqueName: \"kubernetes.io/projected/9c01cda0-1424-42c3-be61-ac4204717079-kube-api-access-wddjq\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.838759 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.838515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-webhook-cert\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.841005 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.840979    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-metrics-certs\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.841130 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.841010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-webhook-cert\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:50.847217 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:50.847190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddjq\" (UniqueName: \"kubernetes.io/projected/9c01cda0-1424-42c3-be61-ac4204717079-kube-api-access-wddjq\") pod \"maas-controller-6f8fccc7c5-g94hz\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") " pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:51.023906 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:51.023798    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:51.297090 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:51.297057    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-g94hz"]
Sep 10 21:27:51.299392 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:27:51.299358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c01cda0_1424_42c3_be61_ac4204717079.slice/crio-6a2a616549324948fec3f169552ca4c839618884cc621bc49e080373bcb4769b WatchSource:0}: Error finding container 6a2a616549324948fec3f169552ca4c839618884cc621bc49e080373bcb4769b: Status 404 returned error can't find the container with id 6a2a616549324948fec3f169552ca4c839618884cc621bc49e080373bcb4769b
Sep 10 21:27:51.300838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:51.300816    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:27:52.237422 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:52.237368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz" event={"ID":"9c01cda0-1424-42c3-be61-ac4204717079","Type":"ContainerStarted","Data":"35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e"}
Sep 10 21:27:52.237853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:52.237444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz" event={"ID":"9c01cda0-1424-42c3-be61-ac4204717079","Type":"ContainerStarted","Data":"6a2a616549324948fec3f169552ca4c839618884cc621bc49e080373bcb4769b"}
Sep 10 21:27:52.237853 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:52.237603    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:27:52.256291 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:52.256237    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz" podStartSLOduration=1.77001565 podStartE2EDuration="2.25622043s" totalImagesPullingTime="486.20478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:27:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:27:52.255494183 +0000 UTC m=+1794.689324134" watchObservedRunningTime="2026-09-10 21:27:52.25622043 +0000 UTC m=+1794.690050389"
Sep 10 21:27:58.166893 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:58.166864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:27:58.172794 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:27:58.172773    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:28:03.245560 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:03.245528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:28:12.424875 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.424833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:28:12.528194 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.528155    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-g94hz"]
Sep 10 21:28:12.528422 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.528358    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz" podUID="9c01cda0-1424-42c3-be61-ac4204717079" containerName="manager" containerID="cri-o://35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e" gracePeriod=30
Sep 10 21:28:12.792676 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.792646    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:28:12.967319 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.967232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-metrics-certs\") pod \"9c01cda0-1424-42c3-be61-ac4204717079\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") "
Sep 10 21:28:12.967319 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.967317    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wddjq\" (UniqueName: \"kubernetes.io/projected/9c01cda0-1424-42c3-be61-ac4204717079-kube-api-access-wddjq\") pod \"9c01cda0-1424-42c3-be61-ac4204717079\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") "
Sep 10 21:28:12.967548 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.967392    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-webhook-cert\") pod \"9c01cda0-1424-42c3-be61-ac4204717079\" (UID: \"9c01cda0-1424-42c3-be61-ac4204717079\") "
Sep 10 21:28:12.969575 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.969536    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9c01cda0-1424-42c3-be61-ac4204717079" (UID: "9c01cda0-1424-42c3-be61-ac4204717079"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:28:12.969700 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.969575    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9c01cda0-1424-42c3-be61-ac4204717079" (UID: "9c01cda0-1424-42c3-be61-ac4204717079"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:28:12.969700 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:12.969605    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c01cda0-1424-42c3-be61-ac4204717079-kube-api-access-wddjq" (OuterVolumeSpecName: "kube-api-access-wddjq") pod "9c01cda0-1424-42c3-be61-ac4204717079" (UID: "9c01cda0-1424-42c3-be61-ac4204717079"). InnerVolumeSpecName "kube-api-access-wddjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:28:13.068359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.068316    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-webhook-cert\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:28:13.068359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.068349    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c01cda0-1424-42c3-be61-ac4204717079-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:28:13.068359 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.068360    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wddjq\" (UniqueName: \"kubernetes.io/projected/9c01cda0-1424-42c3-be61-ac4204717079-kube-api-access-wddjq\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:28:13.356642 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.356600    2573 generic.go:356] "Generic (PLEG): container finished" podID="9c01cda0-1424-42c3-be61-ac4204717079" containerID="35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e" exitCode=0
Sep 10 21:28:13.356854 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.356662    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz"
Sep 10 21:28:13.356854 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.356681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz" event={"ID":"9c01cda0-1424-42c3-be61-ac4204717079","Type":"ContainerDied","Data":"35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e"}
Sep 10 21:28:13.356854 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.356734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-g94hz" event={"ID":"9c01cda0-1424-42c3-be61-ac4204717079","Type":"ContainerDied","Data":"6a2a616549324948fec3f169552ca4c839618884cc621bc49e080373bcb4769b"}
Sep 10 21:28:13.356854 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.356756    2573 scope.go:117] "RemoveContainer" containerID="35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e"
Sep 10 21:28:13.369086 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.369061    2573 scope.go:117] "RemoveContainer" containerID="35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e"
Sep 10 21:28:13.369457 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:28:13.369435    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e\": container with ID starting with 35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e not found: ID does not exist" containerID="35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e"
Sep 10 21:28:13.369545 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.369464    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e"} err="failed to get container status \"35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e\": rpc error: code = NotFound desc = could not find container \"35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e\": container with ID starting with 35687a056cd49949dbe4f423f3204092c2d63a2169dbf5bdcd4c7158616a945e not found: ID does not exist"
Sep 10 21:28:13.381091 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.381066    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-g94hz"]
Sep 10 21:28:13.385189 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:13.385168    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-g94hz"]
Sep 10 21:28:14.002230 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.002201    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:28:14.043479 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.043449    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c01cda0-1424-42c3-be61-ac4204717079" path="/var/lib/kubelet/pods/9c01cda0-1424-42c3-be61-ac4204717079/volumes"
Sep 10 21:28:14.113776 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.113739    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-fk5wg"]
Sep 10 21:28:14.114167 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.114153    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c01cda0-1424-42c3-be61-ac4204717079" containerName="manager"
Sep 10 21:28:14.114167 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.114168    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c01cda0-1424-42c3-be61-ac4204717079" containerName="manager"
Sep 10 21:28:14.114286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.114242    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c01cda0-1424-42c3-be61-ac4204717079" containerName="manager"
Sep 10 21:28:14.114286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.114254    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc709b02-dc52-4fc3-ab95-daad71b99e88" containerName="istio-proxy"
Sep 10 21:28:14.114286 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.114260    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc774f30-97e6-4c81-b621-4e5bc7b51955" containerName="istio-proxy"
Sep 10 21:28:14.119987 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.119968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.122327 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.122294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 21:28:14.122448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.122390    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 21:28:14.123365 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.123346    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fq4km\""
Sep 10 21:28:14.123365 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.123356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 21:28:14.127604 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.127479    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-fk5wg"]
Sep 10 21:28:14.281600 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.281486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-metrics-certs\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.281600 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.281526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-webhook-cert\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.281829 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.281650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8dgj\" (UniqueName: \"kubernetes.io/projected/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-kube-api-access-t8dgj\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.382965 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.382925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-metrics-certs\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.382965 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.382973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-webhook-cert\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.383244 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.383076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8dgj\" (UniqueName: \"kubernetes.io/projected/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-kube-api-access-t8dgj\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.385634 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.385603    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-metrics-certs\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.385765 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.385729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-webhook-cert\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.391535 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.391508    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8dgj\" (UniqueName: \"kubernetes.io/projected/ff7b7637-d832-40bf-aa4d-3ce9cae3397f-kube-api-access-t8dgj\") pod \"maas-controller-6f8fccc7c5-fk5wg\" (UID: \"ff7b7637-d832-40bf-aa4d-3ce9cae3397f\") " pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.431566 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.431521    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:14.707895 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:14.707858    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8fccc7c5-fk5wg"]
Sep 10 21:28:14.710035 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:28:14.709999    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7b7637_d832_40bf_aa4d_3ce9cae3397f.slice/crio-3760233ad4d99efcdb3d7b1f8b1a8f5197beec7ebc9447b18387cf5849409a82 WatchSource:0}: Error finding container 3760233ad4d99efcdb3d7b1f8b1a8f5197beec7ebc9447b18387cf5849409a82: Status 404 returned error can't find the container with id 3760233ad4d99efcdb3d7b1f8b1a8f5197beec7ebc9447b18387cf5849409a82
Sep 10 21:28:15.370223 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:15.370190    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg" event={"ID":"ff7b7637-d832-40bf-aa4d-3ce9cae3397f","Type":"ContainerStarted","Data":"6c53c204d938c59f7d16370aa935a28f611901d12f8b05a1033406d486809ff4"}
Sep 10 21:28:15.370650 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:15.370241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg" event={"ID":"ff7b7637-d832-40bf-aa4d-3ce9cae3397f","Type":"ContainerStarted","Data":"3760233ad4d99efcdb3d7b1f8b1a8f5197beec7ebc9447b18387cf5849409a82"}
Sep 10 21:28:15.370650 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:15.370268    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:15.387027 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:15.386970    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg" podStartSLOduration=1.063541075 podStartE2EDuration="1.386948159s" totalImagesPullingTime="323.407084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:28:15.386598078 +0000 UTC m=+1817.820428066" watchObservedRunningTime="2026-09-10 21:28:15.386948159 +0000 UTC m=+1817.820778110"
Sep 10 21:28:26.377821 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:26.377791    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f8fccc7c5-fk5wg"
Sep 10 21:28:58.423825 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:28:58.423786    2573 scope.go:117] "RemoveContainer" containerID="d7c7704c482a2b331e552f96c37ae9eab42a8627c4279536d6dbb35921489a96"
Sep 10 21:29:20.984078 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:20.983980    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"]
Sep 10 21:29:20.984537 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:20.984257    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8" podUID="0bc5066d-535d-4bdd-ad90-c9f3549cd57e" containerName="manager" containerID="cri-o://affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714" gracePeriod=10
Sep 10 21:29:22.346469 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.346438    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:29:22.464976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.464878    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-extensions-socket-volume\") pod \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") "
Sep 10 21:29:22.464976 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.464938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzrrh\" (UniqueName: \"kubernetes.io/projected/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-kube-api-access-lzrrh\") pod \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\" (UID: \"0bc5066d-535d-4bdd-ad90-c9f3549cd57e\") "
Sep 10 21:29:22.465368 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.465340    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0bc5066d-535d-4bdd-ad90-c9f3549cd57e" (UID: "0bc5066d-535d-4bdd-ad90-c9f3549cd57e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:29:22.467181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.467149    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-kube-api-access-lzrrh" (OuterVolumeSpecName: "kube-api-access-lzrrh") pod "0bc5066d-535d-4bdd-ad90-c9f3549cd57e" (UID: "0bc5066d-535d-4bdd-ad90-c9f3549cd57e"). InnerVolumeSpecName "kube-api-access-lzrrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:29:22.565984 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.565942    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzrrh\" (UniqueName: \"kubernetes.io/projected/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-kube-api-access-lzrrh\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:29:22.565984 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.565973    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0bc5066d-535d-4bdd-ad90-c9f3549cd57e-extensions-socket-volume\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:29:22.728535 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.728448    2573 generic.go:356] "Generic (PLEG): container finished" podID="0bc5066d-535d-4bdd-ad90-c9f3549cd57e" containerID="affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714" exitCode=0
Sep 10 21:29:22.728535 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.728499    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"
Sep 10 21:29:22.728718 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.728533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8" event={"ID":"0bc5066d-535d-4bdd-ad90-c9f3549cd57e","Type":"ContainerDied","Data":"affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714"}
Sep 10 21:29:22.728718 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.728588    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8" event={"ID":"0bc5066d-535d-4bdd-ad90-c9f3549cd57e","Type":"ContainerDied","Data":"03980de99fbaee3725d8e99941366e81f3797e32b27efc9a381a6bb57ecc1536"}
Sep 10 21:29:22.728718 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.728612    2573 scope.go:117] "RemoveContainer" containerID="affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714"
Sep 10 21:29:22.738308 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.738293    2573 scope.go:117] "RemoveContainer" containerID="affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714"
Sep 10 21:29:22.738622 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:29:22.738602    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714\": container with ID starting with affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714 not found: ID does not exist" containerID="affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714"
Sep 10 21:29:22.738689 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.738631    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714"} err="failed to get container status \"affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714\": rpc error: code = NotFound desc = could not find container \"affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714\": container with ID starting with affceee64516eada9661b18e6141e2a010fa12eeb8d64f7c519a8862c52c3714 not found: ID does not exist"
Sep 10 21:29:22.750372 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.750341    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"]
Sep 10 21:29:22.754750 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:22.754721    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-f7sf8"]
Sep 10 21:29:24.043085 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:24.043051    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc5066d-535d-4bdd-ad90-c9f3549cd57e" path="/var/lib/kubelet/pods/0bc5066d-535d-4bdd-ad90-c9f3549cd57e/volumes"
Sep 10 21:29:36.838131 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:36.838085    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:29:37.762307 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:29:37.762273    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:30:21.651056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.651018    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"]
Sep 10 21:30:21.651751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.651629    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc5066d-535d-4bdd-ad90-c9f3549cd57e" containerName="manager"
Sep 10 21:30:21.651751 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.651651    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc5066d-535d-4bdd-ad90-c9f3549cd57e" containerName="manager"
Sep 10 21:30:21.651875 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.651792    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc5066d-535d-4bdd-ad90-c9f3549cd57e" containerName="manager"
Sep 10 21:30:21.654901 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.654881    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.657748 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.657728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f24fn\""
Sep 10 21:30:21.668612 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.668579    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"]
Sep 10 21:30:21.722313 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.722274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7krzt\" (UniqueName: \"kubernetes.io/projected/e7fad47d-0e1b-43f8-bbf8-a6243c6f462d-kube-api-access-7krzt\") pod \"kuadrant-operator-controller-manager-5769f99d9f-645gp\" (UID: \"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.722538 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.722338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7fad47d-0e1b-43f8-bbf8-a6243c6f462d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-645gp\" (UID: \"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.823424 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.823364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7krzt\" (UniqueName: \"kubernetes.io/projected/e7fad47d-0e1b-43f8-bbf8-a6243c6f462d-kube-api-access-7krzt\") pod \"kuadrant-operator-controller-manager-5769f99d9f-645gp\" (UID: \"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.823625 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.823462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7fad47d-0e1b-43f8-bbf8-a6243c6f462d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-645gp\" (UID: \"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.823886 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.823862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7fad47d-0e1b-43f8-bbf8-a6243c6f462d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-645gp\" (UID: \"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.837645 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.837612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7krzt\" (UniqueName: \"kubernetes.io/projected/e7fad47d-0e1b-43f8-bbf8-a6243c6f462d-kube-api-access-7krzt\") pod \"kuadrant-operator-controller-manager-5769f99d9f-645gp\" (UID: \"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:21.968621 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:21.968529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:22.242510 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:22.242484    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"]
Sep 10 21:30:22.244618 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:30:22.244585    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fad47d_0e1b_43f8_bbf8_a6243c6f462d.slice/crio-bb54093e0158a37346c3968c2d5092ac78d2fbeb3d55feb2d7f834fe2afe5d6b WatchSource:0}: Error finding container bb54093e0158a37346c3968c2d5092ac78d2fbeb3d55feb2d7f834fe2afe5d6b: Status 404 returned error can't find the container with id bb54093e0158a37346c3968c2d5092ac78d2fbeb3d55feb2d7f834fe2afe5d6b
Sep 10 21:30:23.032677 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:23.032638    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp" event={"ID":"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d","Type":"ContainerStarted","Data":"7452a96564a0e8e0717814bc88e6155535d7b3a8bb513f3ccb38711746d018e6"}
Sep 10 21:30:23.033142 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:23.032697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp" event={"ID":"e7fad47d-0e1b-43f8-bbf8-a6243c6f462d","Type":"ContainerStarted","Data":"bb54093e0158a37346c3968c2d5092ac78d2fbeb3d55feb2d7f834fe2afe5d6b"}
Sep 10 21:30:23.033142 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:23.032719    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:23.052205 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:23.052135    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp" podStartSLOduration=2.052111293 podStartE2EDuration="2.052111293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:30:23.050332591 +0000 UTC m=+1945.484162539" watchObservedRunningTime="2026-09-10 21:30:23.052111293 +0000 UTC m=+1945.485941243"
Sep 10 21:30:34.043049 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:34.043012    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-645gp"
Sep 10 21:30:59.460157 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:30:59.460073    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:05.696452 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:05.696394    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:25.950840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:25.950793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:36.459342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:36.459313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:37.363494 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:37.363457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:31:54.069051 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.069010    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"]
Sep 10 21:31:54.073622 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.073597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.080996 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.080968    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"]
Sep 10 21:31:54.242353 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.242316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5461192d-5354-4185-81a7-63c9f96319f9-metrics-certs\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.242559 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.242366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5461192d-5354-4185-81a7-63c9f96319f9-openshift-service-ca\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.242559 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.242490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqgkb\" (UniqueName: \"kubernetes.io/projected/5461192d-5354-4185-81a7-63c9f96319f9-kube-api-access-cqgkb\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.242559 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.242540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5461192d-5354-4185-81a7-63c9f96319f9-maas-api-tls\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.343550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.343450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5461192d-5354-4185-81a7-63c9f96319f9-maas-api-tls\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.343550 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.343527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5461192d-5354-4185-81a7-63c9f96319f9-metrics-certs\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.343809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.343580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5461192d-5354-4185-81a7-63c9f96319f9-openshift-service-ca\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.343809 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.343658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqgkb\" (UniqueName: \"kubernetes.io/projected/5461192d-5354-4185-81a7-63c9f96319f9-kube-api-access-cqgkb\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.344342 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.344303    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5461192d-5354-4185-81a7-63c9f96319f9-openshift-service-ca\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.346200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.346177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5461192d-5354-4185-81a7-63c9f96319f9-maas-api-tls\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.346200 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.346197    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5461192d-5354-4185-81a7-63c9f96319f9-metrics-certs\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.351213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.351171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqgkb\" (UniqueName: \"kubernetes.io/projected/5461192d-5354-4185-81a7-63c9f96319f9-kube-api-access-cqgkb\") pod \"maas-api-58d8fbff5d-tm49r\" (UID: \"5461192d-5354-4185-81a7-63c9f96319f9\") " pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.388336 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.388297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:54.666908 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:54.666874    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"]
Sep 10 21:31:54.668465 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:31:54.668437    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5461192d_5354_4185_81a7_63c9f96319f9.slice/crio-51e164ed5f845343f25405994e4b392864f46e328fca46a52106ca49a999b524 WatchSource:0}: Error finding container 51e164ed5f845343f25405994e4b392864f46e328fca46a52106ca49a999b524: Status 404 returned error can't find the container with id 51e164ed5f845343f25405994e4b392864f46e328fca46a52106ca49a999b524
Sep 10 21:31:55.534249 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:55.534150    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r" event={"ID":"5461192d-5354-4185-81a7-63c9f96319f9","Type":"ContainerStarted","Data":"da8f2a7cad2f9aa2786ffe552711fa3be477b602338399eb078a03012a84983b"}
Sep 10 21:31:55.534754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:55.534298    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:31:55.534754 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:55.534320    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r" event={"ID":"5461192d-5354-4185-81a7-63c9f96319f9","Type":"ContainerStarted","Data":"51e164ed5f845343f25405994e4b392864f46e328fca46a52106ca49a999b524"}
Sep 10 21:31:55.549159 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:31:55.549102    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r" podStartSLOduration=1.124587685 podStartE2EDuration="1.549082009s" totalImagesPullingTime="424.494324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:31:55.548894197 +0000 UTC m=+2037.982724159" watchObservedRunningTime="2026-09-10 21:31:55.549082009 +0000 UTC m=+2037.982911962"
Sep 10 21:32:01.544891 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:01.544860    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-58d8fbff5d-tm49r"
Sep 10 21:32:08.071580 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:08.071545    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:32:08.121513 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:08.121480    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:32:08.848664 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:08.848608    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"]
Sep 10 21:32:08.848971 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:08.848935    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w" podUID="f0885058-b15d-4ef0-9fbc-24b1df9867de" containerName="maas-api" containerID="cri-o://f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a" gracePeriod=30
Sep 10 21:32:10.114304 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.114275    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:32:10.197188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.197093    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-metrics-certs\") pod \"f0885058-b15d-4ef0-9fbc-24b1df9867de\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") "
Sep 10 21:32:10.197188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.197145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-maas-api-tls\") pod \"f0885058-b15d-4ef0-9fbc-24b1df9867de\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") "
Sep 10 21:32:10.197188 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.197165    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0885058-b15d-4ef0-9fbc-24b1df9867de-openshift-service-ca\") pod \"f0885058-b15d-4ef0-9fbc-24b1df9867de\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") "
Sep 10 21:32:10.197460 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.197194    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jghtl\" (UniqueName: \"kubernetes.io/projected/f0885058-b15d-4ef0-9fbc-24b1df9867de-kube-api-access-jghtl\") pod \"f0885058-b15d-4ef0-9fbc-24b1df9867de\" (UID: \"f0885058-b15d-4ef0-9fbc-24b1df9867de\") "
Sep 10 21:32:10.197626 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.197589    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0885058-b15d-4ef0-9fbc-24b1df9867de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0885058-b15d-4ef0-9fbc-24b1df9867de" (UID: "f0885058-b15d-4ef0-9fbc-24b1df9867de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:32:10.199331 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.199301    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0885058-b15d-4ef0-9fbc-24b1df9867de" (UID: "f0885058-b15d-4ef0-9fbc-24b1df9867de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:32:10.199495 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.199319    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0885058-b15d-4ef0-9fbc-24b1df9867de" (UID: "f0885058-b15d-4ef0-9fbc-24b1df9867de"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:32:10.199495 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.199410    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0885058-b15d-4ef0-9fbc-24b1df9867de-kube-api-access-jghtl" (OuterVolumeSpecName: "kube-api-access-jghtl") pod "f0885058-b15d-4ef0-9fbc-24b1df9867de" (UID: "f0885058-b15d-4ef0-9fbc-24b1df9867de"). InnerVolumeSpecName "kube-api-access-jghtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:32:10.298502 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.298461    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-metrics-certs\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:32:10.298502 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.298493    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0885058-b15d-4ef0-9fbc-24b1df9867de-maas-api-tls\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:32:10.298502 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.298503    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0885058-b15d-4ef0-9fbc-24b1df9867de-openshift-service-ca\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:32:10.298502 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.298512    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jghtl\" (UniqueName: \"kubernetes.io/projected/f0885058-b15d-4ef0-9fbc-24b1df9867de-kube-api-access-jghtl\") on node \"ip-10-0-135-116.ec2.internal\" DevicePath \"\""
Sep 10 21:32:10.615310 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.615269    2573 generic.go:356] "Generic (PLEG): container finished" podID="f0885058-b15d-4ef0-9fbc-24b1df9867de" containerID="f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a" exitCode=0
Sep 10 21:32:10.615310 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.615307    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"
Sep 10 21:32:10.615604 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.615358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w" event={"ID":"f0885058-b15d-4ef0-9fbc-24b1df9867de","Type":"ContainerDied","Data":"f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a"}
Sep 10 21:32:10.615604 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.615425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d8489f74-9kx6w" event={"ID":"f0885058-b15d-4ef0-9fbc-24b1df9867de","Type":"ContainerDied","Data":"050ab6381d0fb4b4ce414614fa9ef0dea1f86deeb0e55d60a82b3d3aba022ed5"}
Sep 10 21:32:10.615604 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.615448    2573 scope.go:117] "RemoveContainer" containerID="f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a"
Sep 10 21:32:10.625576 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.625553    2573 scope.go:117] "RemoveContainer" containerID="f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a"
Sep 10 21:32:10.625842 ip-10-0-135-116 kubenswrapper[2573]: E0910 21:32:10.625823    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a\": container with ID starting with f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a not found: ID does not exist" containerID="f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a"
Sep 10 21:32:10.625929 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.625849    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a"} err="failed to get container status \"f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a\": rpc error: code = NotFound desc = could not find container \"f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a\": container with ID starting with f6b90f3568a65aae1831c0760dd199ba84902a93570abb1a99143b51763e757a not found: ID does not exist"
Sep 10 21:32:10.637458 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.637432    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"]
Sep 10 21:32:10.639569 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:10.639537    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-d8489f74-9kx6w"]
Sep 10 21:32:12.045836 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:12.045757    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0885058-b15d-4ef0-9fbc-24b1df9867de" path="/var/lib/kubelet/pods/f0885058-b15d-4ef0-9fbc-24b1df9867de/volumes"
Sep 10 21:32:28.684958 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:28.684912    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6x884_0d175112-fd7b-4976-9f61-5e03599b92db/manager/0.log"
Sep 10 21:32:28.792837 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:28.792806    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7fggj_040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5/manager/0.log"
Sep 10 21:32:28.909117 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:28.909085    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f8fccc7c5-fk5wg_ff7b7637-d832-40bf-aa4d-3ce9cae3397f/manager/0.log"
Sep 10 21:32:29.256973 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:29.256943    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-fw2lm_f936dc0e-86e3-48d8-8105-c449399efc31/copy-manifests/0.log"
Sep 10 21:32:29.263933 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:29.263908    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-fw2lm_f936dc0e-86e3-48d8-8105-c449399efc31/manager/0.log"
Sep 10 21:32:29.926132 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:29.926103    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-58d8fbff5d-tm49r_5461192d-5354-4185-81a7-63c9f96319f9/maas-api/0.log"
Sep 10 21:32:30.242940 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:30.242857    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sz8hg_973c7228-3a7b-4702-8222-07ea7ac53da6/postgres/0.log"
Sep 10 21:32:31.087727 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:31.087695    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-89snh_e64caa1a-1998-43a7-9e06-a1bf77b96434/manager/0.log"
Sep 10 21:32:31.194435 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:31.194393    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-mjp6q_4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f/manager/0.log"
Sep 10 21:32:31.420912 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:31.420823    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-645gp_e7fad47d-0e1b-43f8-bbf8-a6243c6f462d/manager/0.log"
Sep 10 21:32:31.680040 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:31.679964    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-66ghd_55cb5039-fdce-4a16-a518-215f62842a79/manager/0.log"
Sep 10 21:32:32.246943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:32.246914    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767744946f-qhd87_0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50/kube-auth-proxy/0.log"
Sep 10 21:32:32.465686 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:32.465657    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/1.log"
Sep 10 21:32:32.573908 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:32.573881    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-j4c88_76ce6e80-7369-403a-94f6-493710bc14e1/payload-pre-processing/0.log"
Sep 10 21:32:33.123571 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:33.123536    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qb9f7_db73ef0e-2267-40ef-b7ea-6b97e73783d9/main/0.log"
Sep 10 21:32:33.335786 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:33.335756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-rd8jk_e156febd-625f-4192-9906-23ecdc4a26a5/main/0.log"
Sep 10 21:32:33.647831 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:33.647802    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9scg9_b0eef350-f71e-49c5-8d4a-2d9aaddc274e/main/0.log"
Sep 10 21:32:39.049537 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:39.049503    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:32:39.148927 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:39.148891    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log" limit=1024
Sep 10 21:32:41.802914 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:41.802884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g2g24_40579060-85b2-4b38-9eb7-2a97dfb3780b/global-pull-secret-syncer/0.log"
Sep 10 21:32:41.894138 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:41.894103    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-blzx5_f7938aa9-84a2-4ea2-a2db-bad2cb530c10/konnectivity-agent/0.log"
Sep 10 21:32:41.973665 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:41.973613    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-116.ec2.internal_4ee37362506138ee29eeccd68e40c0bf/haproxy/0.log"
Sep 10 21:32:45.986982 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:45.986951    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-89snh_e64caa1a-1998-43a7-9e06-a1bf77b96434/manager/0.log"
Sep 10 21:32:46.011556 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:46.011525    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-mjp6q_4e970c7e-01f9-4d9a-90fe-ce8e35b8fa9f/manager/0.log"
Sep 10 21:32:46.075056 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:46.075026    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-645gp_e7fad47d-0e1b-43f8-bbf8-a6243c6f462d/manager/0.log"
Sep 10 21:32:46.179128 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:46.179096    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-66ghd_55cb5039-fdce-4a16-a518-215f62842a79/manager/0.log"
Sep 10 21:32:48.013940 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.013910    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wmgw4_3b07e001-c07b-47cb-9f71-1a5f315c8d3c/kube-state-metrics/0.log"
Sep 10 21:32:48.032840 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.032811    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wmgw4_3b07e001-c07b-47cb-9f71-1a5f315c8d3c/kube-rbac-proxy-main/0.log"
Sep 10 21:32:48.054167 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.054139    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wmgw4_3b07e001-c07b-47cb-9f71-1a5f315c8d3c/kube-rbac-proxy-self/0.log"
Sep 10 21:32:48.078184 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.078157    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b77cd6694-sc74x_bd3d372f-f376-4778-8f16-00b1a4e7a88d/metrics-server/0.log"
Sep 10 21:32:48.102720 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.102695    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-zrf4v_f675b250-f978-4494-9219-c3ecb6ad1851/monitoring-plugin/0.log"
Sep 10 21:32:48.275015 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.274915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvpl8_31ad4b19-a57a-4e29-bc62-8faab79874aa/node-exporter/0.log"
Sep 10 21:32:48.296687 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.296639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvpl8_31ad4b19-a57a-4e29-bc62-8faab79874aa/kube-rbac-proxy/0.log"
Sep 10 21:32:48.317989 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.317966    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvpl8_31ad4b19-a57a-4e29-bc62-8faab79874aa/init-textfile/0.log"
Sep 10 21:32:48.423595 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.423563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/prometheus/0.log"
Sep 10 21:32:48.445714 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.445685    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/config-reloader/0.log"
Sep 10 21:32:48.468927 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.468899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/thanos-sidecar/0.log"
Sep 10 21:32:48.486611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.486581    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/kube-rbac-proxy-web/0.log"
Sep 10 21:32:48.510538 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.510512    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/kube-rbac-proxy/0.log"
Sep 10 21:32:48.529492 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.529416    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/kube-rbac-proxy-thanos/0.log"
Sep 10 21:32:48.548506 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.548476    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21cb227e-0482-44bf-a5ca-83c2cddc8322/init-config-reloader/0.log"
Sep 10 21:32:48.574019 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.573988    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-4l7w9_4c624d33-94ee-4c06-97d8-84836ab17b75/prometheus-operator/0.log"
Sep 10 21:32:48.591584 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.591557    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-4l7w9_4c624d33-94ee-4c06-97d8-84836ab17b75/kube-rbac-proxy/0.log"
Sep 10 21:32:48.617014 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.616989    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-hw6z5_d855d43a-1872-4673-ac57-8bdc54f80907/prometheus-operator-admission-webhook/0.log"
Sep 10 21:32:48.652545 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.652517    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d779bd744-ckpbt_898778d1-c747-442b-a1cd-3ddf930ebfea/telemeter-client/0.log"
Sep 10 21:32:48.680664 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.680641    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d779bd744-ckpbt_898778d1-c747-442b-a1cd-3ddf930ebfea/reload/0.log"
Sep 10 21:32:48.702588 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:48.702559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d779bd744-ckpbt_898778d1-c747-442b-a1cd-3ddf930ebfea/kube-rbac-proxy/0.log"
Sep 10 21:32:51.865954 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:51.865922    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-9ct2d_c2e6714f-e65f-4c23-91a9-8f3b15d0843d/download-server/0.log"
Sep 10 21:32:52.177224 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.177140    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"]
Sep 10 21:32:52.177709 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.177686    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0885058-b15d-4ef0-9fbc-24b1df9867de" containerName="maas-api"
Sep 10 21:32:52.177875 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.177750    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0885058-b15d-4ef0-9fbc-24b1df9867de" containerName="maas-api"
Sep 10 21:32:52.177943 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.177882    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0885058-b15d-4ef0-9fbc-24b1df9867de" containerName="maas-api"
Sep 10 21:32:52.181294 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.181272    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.183686 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.183667    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47z52\"/\"openshift-service-ca.crt\""
Sep 10 21:32:52.183784 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.183670    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47z52\"/\"kube-root-ca.crt\""
Sep 10 21:32:52.184838 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.184720    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47z52\"/\"default-dockercfg-fsfx2\""
Sep 10 21:32:52.187993 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.187969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"]
Sep 10 21:32:52.202343 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.202314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-sys\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.202519 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.202355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-podres\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.202578 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.202518    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gg2\" (UniqueName: \"kubernetes.io/projected/4144b38d-aba7-410e-afbd-74b330493678-kube-api-access-q9gg2\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.202578 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.202570    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-proc\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.202675 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.202608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-lib-modules\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304081 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gg2\" (UniqueName: \"kubernetes.io/projected/4144b38d-aba7-410e-afbd-74b330493678-kube-api-access-q9gg2\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-proc\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-lib-modules\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304207    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-sys\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-proc\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-podres\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304295 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-sys\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304577 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-lib-modules\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.304577 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.304446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4144b38d-aba7-410e-afbd-74b330493678-podres\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.312009 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.311982    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gg2\" (UniqueName: \"kubernetes.io/projected/4144b38d-aba7-410e-afbd-74b330493678-kube-api-access-q9gg2\") pod \"perf-node-gather-daemonset-td5j2\" (UID: \"4144b38d-aba7-410e-afbd-74b330493678\") " pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.493752 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.493655    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:52.765489 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.765462    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"]
Sep 10 21:32:52.768013 ip-10-0-135-116 kubenswrapper[2573]: W0910 21:32:52.767985    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4144b38d_aba7_410e_afbd_74b330493678.slice/crio-ec0da88d2924c5cc23c2a1ed145226a4ecfb019fcf78cfa4fb5db67a69db772a WatchSource:0}: Error finding container ec0da88d2924c5cc23c2a1ed145226a4ecfb019fcf78cfa4fb5db67a69db772a: Status 404 returned error can't find the container with id ec0da88d2924c5cc23c2a1ed145226a4ecfb019fcf78cfa4fb5db67a69db772a
Sep 10 21:32:52.837792 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:52.837757    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2" event={"ID":"4144b38d-aba7-410e-afbd-74b330493678","Type":"ContainerStarted","Data":"ec0da88d2924c5cc23c2a1ed145226a4ecfb019fcf78cfa4fb5db67a69db772a"}
Sep 10 21:32:53.775866 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:53.775839    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p4kv6_31902c8e-2222-4b0e-8adf-7796567b1f9e/dns/0.log"
Sep 10 21:32:53.793828 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:53.793802    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p4kv6_31902c8e-2222-4b0e-8adf-7796567b1f9e/kube-rbac-proxy/0.log"
Sep 10 21:32:53.843865 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:53.843833    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2" event={"ID":"4144b38d-aba7-410e-afbd-74b330493678","Type":"ContainerStarted","Data":"3c9b6dd336c41602a4a44a0983a30f33525396bf62ba392e6897adb8b661418b"}
Sep 10 21:32:53.844047 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:53.843960    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:32:53.853325 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:53.853300    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tn5w_4c221f57-edf1-4e02-a377-5c5ecb6bf30c/dns-node-resolver/0.log"
Sep 10 21:32:53.858979 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:53.858930    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2" podStartSLOduration=1.858915606 podStartE2EDuration="1.858915606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:32:53.857928135 +0000 UTC m=+2096.291758083" watchObservedRunningTime="2026-09-10 21:32:53.858915606 +0000 UTC m=+2096.292745554"
Sep 10 21:32:54.386448 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:54.386393    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-698ffb8ff8-qpbb7_b549803b-6180-42e3-83f7-9dc04a2732bc/registry/0.log"
Sep 10 21:32:54.405174 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:54.405140    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4psvv_01ccbe4d-ba0b-4888-b17e-e9f340c2d548/node-ca/0.log"
Sep 10 21:32:55.545430 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:55.545389    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767744946f-qhd87_0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50/kube-auth-proxy/0.log"
Sep 10 21:32:55.594461 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:55.594423    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/0.log"
Sep 10 21:32:55.602375 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:55.602346    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/1.log"
Sep 10 21:32:55.635388 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:55.635358    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-j4c88_76ce6e80-7369-403a-94f6-493710bc14e1/payload-pre-processing/0.log"
Sep 10 21:32:56.564320 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:56.564291    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbtl5_40c1025e-87ce-4eef-8f1b-b3f1fe00b0cd/serve-healthcheck-canary/0.log"
Sep 10 21:32:57.103182 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:57.103146    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nm8v4_f5908d2b-16f9-48b6-bf6e-cbce61292c90/kube-rbac-proxy/0.log"
Sep 10 21:32:57.121533 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:57.121505    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nm8v4_f5908d2b-16f9-48b6-bf6e-cbce61292c90/exporter/0.log"
Sep 10 21:32:57.141591 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:57.141562    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nm8v4_f5908d2b-16f9-48b6-bf6e-cbce61292c90/extractor/0.log"
Sep 10 21:32:58.199685 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:58.199654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:32:58.207181 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:58.207160    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:32:59.225046 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:59.225018    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6x884_0d175112-fd7b-4976-9f61-5e03599b92db/manager/0.log"
Sep 10 21:32:59.393977 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:59.393940    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7fggj_040ff9f8-a1f7-4f4c-8b9a-eebaccd518e5/manager/0.log"
Sep 10 21:32:59.436294 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:59.436263    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f8fccc7c5-fk5wg_ff7b7637-d832-40bf-aa4d-3ce9cae3397f/manager/0.log"
Sep 10 21:32:59.553914 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:59.553824    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-fw2lm_f936dc0e-86e3-48d8-8105-c449399efc31/manager/0.log"
Sep 10 21:32:59.576376 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:59.576344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d855cccc6-fw2lm_f936dc0e-86e3-48d8-8105-c449399efc31/copy-manifests/0.log"
Sep 10 21:32:59.860234 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:32:59.860202    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47z52/perf-node-gather-daemonset-td5j2"
Sep 10 21:33:01.001848 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:01.001818    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fcs62_4615ecbc-07de-467b-9cff-484978fef78b/openshift-lws-operator/0.log"
Sep 10 21:33:02.567867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:02.567836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767744946f-qhd87_0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50/kube-auth-proxy/0.log"
Sep 10 21:33:02.596112 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:02.596080    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/0.log"
Sep 10 21:33:02.605284 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:02.605262    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/1.log"
Sep 10 21:33:02.627496 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:02.627467    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-j4c88_76ce6e80-7369-403a-94f6-493710bc14e1/payload-pre-processing/0.log"
Sep 10 21:33:04.462192 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:04.462163    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-767744946f-qhd87_0b962bcb-0ceb-44b6-b2cf-2f34fc5e1f50/kube-auth-proxy/0.log"
Sep 10 21:33:04.494253 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:04.494228    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/0.log"
Sep 10 21:33:04.503256 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:04.503224    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jbrvm_2a2233ce-a61b-403a-912e-3eee8c4e8184/istio-proxy/1.log"
Sep 10 21:33:04.529097 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:04.529060    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-j4c88_76ce6e80-7369-403a-94f6-493710bc14e1/payload-pre-processing/0.log"
Sep 10 21:33:06.233680 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:06.233645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-64rg8_0fc241b8-ff4a-4be7-bc3b-76d683faf82f/migrator/0.log"
Sep 10 21:33:06.270233 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:06.270207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-64rg8_0fc241b8-ff4a-4be7-bc3b-76d683faf82f/graceful-termination/0.log"
Sep 10 21:33:07.756211 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.756181    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/kube-multus-additional-cni-plugins/0.log"
Sep 10 21:33:07.774611 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.774585    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/egress-router-binary-copy/0.log"
Sep 10 21:33:07.792527 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.792505    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/cni-plugins/0.log"
Sep 10 21:33:07.811867 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.811842    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/bond-cni-plugin/0.log"
Sep 10 21:33:07.830971 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.830949    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/routeoverride-cni/0.log"
Sep 10 21:33:07.850714 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.850689    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/whereabouts-cni-bincopy/0.log"
Sep 10 21:33:07.869377 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:07.869353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8hq8_17ea9f04-bab4-40c3-a21a-80e3dd44ecd9/whereabouts-cni/0.log"
Sep 10 21:33:08.051961 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:08.051868    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fk6mv_2f6de03c-5454-4b85-be6e-d6cec7612e65/kube-multus/0.log"
Sep 10 21:33:08.252896 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:08.252864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v8pqm_2404ec37-e8a7-4eb2-b841-a20815a2464a/network-metrics-daemon/0.log"
Sep 10 21:33:08.271026 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:08.270999    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v8pqm_2404ec37-e8a7-4eb2-b841-a20815a2464a/kube-rbac-proxy/0.log"
Sep 10 21:33:09.288771 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.288744    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-controller/0.log"
Sep 10 21:33:09.303109 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.303081    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/1.log"
Sep 10 21:33:09.303109 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.303108    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/ovn-acl-logging/0.log"
Sep 10 21:33:09.318716 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.318688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/kube-rbac-proxy-node/0.log"
Sep 10 21:33:09.338213 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.338179    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 21:33:09.356862 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.356832    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/northd/0.log"
Sep 10 21:33:09.376382 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.376357    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/nbdb/0.log"
Sep 10 21:33:09.395041 ip-10-0-135-116 kubenswrapper[2573]: I0910 21:33:09.395016    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xx4mh_88948997-10ae-459b-bb46-4b7fa8705cf9/sbdb/0.log"