Sep 11 21:17:16.285184 ip-10-0-136-69 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 21:17:16.660983 ip-10-0-136-69 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:17:16.660983 ip-10-0-136-69 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 21:17:16.660983 ip-10-0-136-69 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:17:16.660983 ip-10-0-136-69 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 21:17:16.660983 ip-10-0-136-69 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:17:16.661998 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.661905    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 21:17:16.665655 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665635    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:16.665655 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665652    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:16.665655 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665657    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:16.665655 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665661    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665666    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665673    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665680    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665686    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665690    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665694    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665699    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665703    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665707    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665711    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665714    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665718    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665722    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665726    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665729    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665733    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665738    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665742    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:16.665917 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665746    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665751    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665755    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665759    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665763    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665767    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665771    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665776    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665780    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665784    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665788    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665792    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665796    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665800    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665805    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665810    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665814    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665818    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665823    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665827    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:16.666706 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665832    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665836    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665840    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665845    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665861    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665866    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665871    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665875    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665879    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665883    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665889    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665894    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665899    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665904    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665908    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665912    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665916    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665920    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665924    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665928    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:16.667571 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665932    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665936    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665940    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665944    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665949    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665953    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665958    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665964    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665969    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665973    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665978    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665982    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665986    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665991    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.665995    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666004    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666010    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666015    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666020    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:16.668434 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666024    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666029    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666033    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666037    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666043    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666047    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666052    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666057    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666061    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666065    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666068    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666072    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666077    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666081    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666085    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666089    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666094    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.666098    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667276    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:16.668987 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667286    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667292    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667297    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667302    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667306    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667311    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667315    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667320    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667324    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667328    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667332    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667336    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667340    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667344    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667348    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667353    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667357    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667362    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667366    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667371    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:16.669516 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667376    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667380    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667384    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667388    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667392    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667397    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667401    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667405    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667409    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667413    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667417    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667422    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667428    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667432    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667436    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667440    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667445    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667449    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667453    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667457    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:16.670042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667462    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667466    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667478    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667482    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667486    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667491    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667495    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667499    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667503    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667507    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667512    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667517    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667521    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667525    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667529    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667533    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667537    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667541    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667546    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667550    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:16.670549 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667556    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667563    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667568    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667574    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667581    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667586    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667590    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667594    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667599    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667603    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667607    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667612    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667616    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667621    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667625    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667629    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667636    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667641    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:16.671070 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667646    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667651    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667656    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667660    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667664    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667668    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667674    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667678    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667682    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667687    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667691    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667695    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667699    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667704    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667708    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667712    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667716    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667720    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667724    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.667729    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:16.671538 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668357    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668365    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668370    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668374    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668378    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668383    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668390    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668395    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668401    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668405    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668412    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668417    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668422    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668427    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668431    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668436    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668440    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668444    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668449    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:16.672047 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668453    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668457    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668461    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668466    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668470    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668474    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668478    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668482    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668488    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668495    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668499    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668503    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668507    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668512    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668516    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668520    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668524    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668528    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668532    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:16.672535 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668537    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668541    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668545    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668550    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668554    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668559    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668595    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668617    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668622    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668625    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668629    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668632    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668635    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668638    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668641    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668644    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668647    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668650    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668652    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668656    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:16.673018 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668659    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668661    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668664    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668667    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668669    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668672    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668674    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668677    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668680    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668682    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668685    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668688    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668690    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668693    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668695    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668699    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668702    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668704    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668707    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668714    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:16.673507 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668718    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668720    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668723    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668726    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668729    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668731    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668734    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668736    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668739    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668742    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668745    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668747    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668750    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668752    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668755    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668758    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668760    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668764    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668768    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668771    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:16.674039 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.668774    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668859    2572 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668895    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668902    2572 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668907    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668911    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668914    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668919    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668923    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668926    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668929    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668934    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668939    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668942    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668945    2572 flags.go:64] FLAG: --cgroup-root=""
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668948    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668951    2572 flags.go:64] FLAG: --client-ca-file=""
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668954    2572 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668957    2572 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668961    2572 flags.go:64] FLAG: --cluster-domain=""
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668964    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668968    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668971    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668974    2572 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 21:17:16.674523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668978    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668981    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668984    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668987    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668990    2572 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668993    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.668996    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669000    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669003    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669007    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669010    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669013    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669015    2572 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669019    2572 flags.go:64] FLAG: --enable-server="true"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669022    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669027    2572 flags.go:64] FLAG: --event-burst="100"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669030    2572 flags.go:64] FLAG: --event-qps="50"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669033    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669036    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669042    2572 flags.go:64] FLAG: --eviction-hard=""
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669045    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669049    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669052    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669055    2572 flags.go:64] FLAG: --eviction-soft=""
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669058    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 21:17:16.675128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669061    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669064    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669067    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669070    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669073    2572 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669076    2572 flags.go:64] FLAG: --feature-gates=""
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669080    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669083    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669086    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669089    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669092    2572 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669095    2572 flags.go:64] FLAG: --help="false"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669098    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-69.ec2.internal"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669101    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669105    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669107    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669111    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669115    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669118    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669121    2572 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669124    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669126    2572 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669129    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669132    2572 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 21:17:16.675795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669135    2572 flags.go:64] FLAG: --kube-reserved=""
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669138    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669143    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669146    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669150    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669153    2572 flags.go:64] FLAG: --lock-file=""
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669156    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669159    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669162    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669168    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669171    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669174    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669177    2572 flags.go:64] FLAG: --logging-format="text"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669180    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669184    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669187    2572 flags.go:64] FLAG: --manifest-url=""
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669190    2572 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669194    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669197    2572 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669201    2572 flags.go:64] FLAG: --max-pods="110"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669204    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669207    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669210    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669213    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669216    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 21:17:16.676594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669219    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669222    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669229    2572 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669232    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669235    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669238    2572 flags.go:64] FLAG: --pod-cidr=""
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669241    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669250    2572 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669253    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669258    2572 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669262    2572 flags.go:64] FLAG: --port="10250"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669265    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669268    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f52587ba0903e023"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669272    2572 flags.go:64] FLAG: --qos-reserved=""
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669275    2572 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669278    2572 flags.go:64] FLAG: --register-node="true"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669281    2572 flags.go:64] FLAG: --register-with-taints=""
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669284    2572 flags.go:64] FLAG: --registry-burst="10"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669287    2572 flags.go:64] FLAG: --registry-qps="5"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669290    2572 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669293    2572 flags.go:64] FLAG: --reserved-memory=""
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669297    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669300    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669303    2572 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669306    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 21:17:16.677431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669308    2572 flags.go:64] FLAG: --runonce="false"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669311    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669314    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669317    2572 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669320    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669323    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669326    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669329    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669332    2572 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669335    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669338    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669341    2572 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669344    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669347    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669349    2572 flags.go:64] FLAG: --system-cgroups=""
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669352    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669362    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669367    2572 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669370    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669374    2572 flags.go:64] FLAG: --tls-min-version=""
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669377    2572 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669381    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669384    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669386    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669389    2572 flags.go:64] FLAG: --v="2"
Sep 11 21:17:16.678067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669393    2572 flags.go:64] FLAG: --version="false"
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669397    2572 flags.go:64] FLAG: --vmodule=""
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669401    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.669404    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669517    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669522    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669526    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669529    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669532    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669535    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669537    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669539    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669542    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669545    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669547    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669550    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669553    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669555    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669558    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669560    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:16.678666 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669563    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669565    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669568    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669572    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669576    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669579    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669581    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669584    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669587    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669590    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669592    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669595    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669598    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669601    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669604    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669606    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669609    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669611    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669614    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669617    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:16.679212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669620    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669622    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669625    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669627    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669630    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669632    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669635    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669638    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669640    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669643    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669646    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669648    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669651    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669653    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669656    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669659    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669663    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669666    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669668    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:16.679726 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669671    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669675    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669678    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669682    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669685    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669688    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669690    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669693    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669696    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669698    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669701    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669703    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669706    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669708    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669711    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669713    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669718    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669721    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669724    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:16.680214 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669727    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669729    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669732    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669735    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669737    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669740    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669742    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669745    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669747    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669752    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669755    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669758    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669761    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669763    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669766    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669768    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669771    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669774    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669777    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669779    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:16.680695 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669782    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669785    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669787    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669790    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.669792    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.670381    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.678201    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.678218    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.678237    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.678244    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678297    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678302    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678306    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678310    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:16.681209 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678313    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678316    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678319    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678322    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678325    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678329    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678331    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678335    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678337    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678341    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678345    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678349    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678352    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678355    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678359    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678362    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678365    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678368    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:16.681563 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678371    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678373    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678376    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678379    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678382    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678384    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678387    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678390    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678393    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678396    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678399    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678401    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678404    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678407    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678410    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678412    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678415    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678418    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678421    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678423    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:16.682022 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678426    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678428    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678431    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678434    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678436    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678439    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678442    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678444    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678447    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678450    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678452    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678455    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678457    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678460    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678463    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678465    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678468    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678471    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678473    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678476    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:16.682506 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678479    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678482    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678485    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678488    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678490    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678493    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678495    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678498    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678500    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678503    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678506    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678508    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678511    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678514    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678517    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678519    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678522    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678525    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678528    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678530    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:16.683052 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678533    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678535    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678539    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678541    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678544    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678547    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678549    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678552    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678554    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678557    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678560    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678564    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678568    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678571    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678574    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678577    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:16.683555 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678579    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.678585    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678692    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678697    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678700    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678702    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678705    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678708    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678711    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678713    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678717    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678719    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678722    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678725    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678728    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:17:16.683967 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678731    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678733    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678735    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678738    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678741    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678744    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678746    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678749    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678751    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678754    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678756    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678759    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678761    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678764    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678766    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678769    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678771    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678774    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678777    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678779    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:17:16.684339 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678782    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678784    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678787    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678789    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678792    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678794    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678798    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678801    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678804    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678807    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678810    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678813    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678817    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678820    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678823    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678827    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678830    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678833    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678835    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:17:16.684837 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678838    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678841    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678843    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678861    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678865    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678867    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678870    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678873    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678875    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678878    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678881    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678883    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678886    2572 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678889    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678891    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678894    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678896    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678899    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678902    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678904    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:17:16.685326 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678907    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678909    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678912    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678914    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678917    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678921    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678926    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678928    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678931    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678934    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678936    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678939    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678942    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678944    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678947    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678949    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678952    2572 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678954    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678957    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:17:16.685818 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678959    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678962    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678964    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678967    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678969    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678972    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678974    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:16.678977    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.678982    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.679096    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.682667    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.683605    2572 server.go:1019] "Starting client certificate rotation"
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.683699    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:17:16.686325 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.683726    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:17:16.686643 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.686037    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:17:16.687217 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.687197    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:17:16.696070 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.696045    2572 log.go:25] "Validated CRI v1 runtime API"
Sep 11 21:17:16.698955 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.698941    2572 log.go:25] "Validated CRI v1 image API"
Sep 11 21:17:16.699871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.699842    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 21:17:16.704190 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.704168    2572 fs.go:135] Filesystem UUIDs: map[15969ecd-7c96-4d12-99a7-681ee9f9b380:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 80dde371-599a-4272-877b-3447ea3c8f3d:/dev/nvme0n1p4]
Sep 11 21:17:16.704246 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.704190    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 21:17:16.710682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.710564    2572 manager.go:216] Machine: {Timestamp:2026-09-11 21:17:16.709075732 +0000 UTC m=+0.311702928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106274 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec240d9741705897db3b474f06279bb4 SystemUUID:ec240d97-4170-5897-db3b-474f06279bb4 BootID:ada97c34-1705-463f-83fe-a99a766a0e5b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:b9:f6:f6:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:b9:f6:f6:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f3:38:63:8d:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 21:17:16.710682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.710672    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 21:17:16.710811 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.710755    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 21:17:16.714366 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.714341    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 21:17:16.714501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.714372    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 21:17:16.715716 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.715705    2572 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 21:17:16.715755 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.715719    2572 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 21:17:16.715755 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.715728    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:17:16.716538 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.716528    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:17:16.716976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.716960    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:17:16.717369 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.717357    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 21:17:16.720421 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720410    2572 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:17:16.720541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720532    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 21:17:16.720575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720560    2572 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 21:17:16.720603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720575    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 21:17:16.720603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720591    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 21:17:16.720603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720600    2572 kubelet.go:398] "Adding apiserver pod source"
Sep 11 21:17:16.720704 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720608    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 21:17:16.720998 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.720986    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:17:16.721043 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.721011    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:17:16.723197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.723183    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 21:17:16.725772 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.725749    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 21:17:16.725826 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.725779    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 21:17:16.727802 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727789    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727805    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727812    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727817    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727826    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727832    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727844    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727866    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727874    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 21:17:16.727874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727880    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 21:17:16.728234 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727889    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 21:17:16.728234 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.727894    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 21:17:16.728583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.728571    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 21:17:16.728583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.728580    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 21:17:16.731891 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.731874    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 21:17:16.732446 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.732425    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 21:17:16.732530 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.732424    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 21:17:16.732530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.732463    2572 server.go:1268] "Started kubelet"
Sep 11 21:17:16.732530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.732509    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 21:17:16.732677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.732608    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 21:17:16.732782 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.732693    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 21:17:16.733506 ip-10-0-136-69 systemd[1]: Started Kubernetes Kubelet.
Sep 11 21:17:16.733864 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.733832    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 21:17:16.736078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.736059    2572 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 21:17:16.738267 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.738249    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 21:17:16.740138 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.739340    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-69.ec2.internal.18d460d8ea43c2e7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-69.ec2.internal,UID:ip-10-0-136-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-69.ec2.internal,},FirstTimestamp:2026-09-11 21:17:16.732441319 +0000 UTC m=+0.335068515,LastTimestamp:2026-09-11 21:17:16.732441319 +0000 UTC m=+0.335068515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-69.ec2.internal,}"
Sep 11 21:17:16.741277 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.741258    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 21:17:16.741790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.741771    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 21:17:16.741926 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.741897    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:16.742802 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.742772    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 21:17:16.743588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.743566    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 21:17:16.743588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.743590    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 21:17:16.743829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.743814    2572 factory.go:55] Registering systemd factory
Sep 11 21:17:16.743829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.743830    2572 factory.go:223] Registration of the systemd container factory successfully
Sep 11 21:17:16.744102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744084    2572 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 21:17:16.744102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744099    2572 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 21:17:16.744221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744131    2572 factory.go:153] Registering CRI-O factory
Sep 11 21:17:16.744221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744142    2572 factory.go:223] Registration of the crio container factory successfully
Sep 11 21:17:16.744221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744209    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 21:17:16.744362 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744244    2572 factory.go:103] Registering Raw factory
Sep 11 21:17:16.744362 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744266    2572 manager.go:1196] Started watching for new ooms in manager
Sep 11 21:17:16.744646 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.744629    2572 manager.go:349] Starting recovery of all containers
Sep 11 21:17:16.746379 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.746342    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 21:17:16.746479 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.746431    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 21:17:16.757298 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.757160    2572 manager.go:354] Recovery completed
Sep 11 21:17:16.762900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.762888    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.764659 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.764633    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.764718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.764675    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.764718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.764691    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.765410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.765395    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 21:17:16.765410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.765409    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 21:17:16.765554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.765399    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.765554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.765427    2572 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:17:16.766197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.766178    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.766251 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.766215    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.766251 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.766232    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.766649 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.766634    2572 policy_none.go:49] "None policy: Start"
Sep 11 21:17:16.766705 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.766657    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 21:17:16.766705 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.766587    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-69.ec2.internal.18d460d8ec2f5b94  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-69.ec2.internal,UID:ip-10-0-136-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-69.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-69.ec2.internal,},FirstTimestamp:2026-09-11 21:17:16.76465858 +0000 UTC m=+0.367285777,LastTimestamp:2026-09-11 21:17:16.76465858 +0000 UTC m=+0.367285777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-69.ec2.internal,}"
Sep 11 21:17:16.766705 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.766670    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 21:17:16.767981 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.767964    2572 policy_none.go:47] "Start"
Sep 11 21:17:16.770613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.770596    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ks4gx"
Sep 11 21:17:16.777923 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.777806    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-69.ec2.internal.18d460d8ec2fb94e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-69.ec2.internal,UID:ip-10-0-136-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-69.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-69.ec2.internal,},FirstTimestamp:2026-09-11 21:17:16.764682574 +0000 UTC m=+0.367309773,LastTimestamp:2026-09-11 21:17:16.764682574 +0000 UTC m=+0.367309773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-69.ec2.internal,}"
Sep 11 21:17:16.778341 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.778315    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ks4gx"
Sep 11 21:17:16.793520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.793505    2572 manager.go:337] "Starting Device Plugin manager"
Sep 11 21:17:16.793612 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.793543    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 21:17:16.793612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.793553    2572 server.go:87] "Starting device plugin registration server"
Sep 11 21:17:16.793984 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.793921    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 21:17:16.793984 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.793946    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 21:17:16.809874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.794412    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 21:17:16.809874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.794485    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 21:17:16.809874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.794494    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 21:17:16.809874 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.795405    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 21:17:16.809874 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.795452    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:16.844606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.844568    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 21:17:16.845796 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.845774    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 21:17:16.845931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.845839    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 21:17:16.845931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.845885    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 21:17:16.846041 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.845932    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 21:17:16.847984 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.847960    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:16.894659 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.894636    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.895709 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.895691    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.895777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.895737    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.895777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.895753    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.895838 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.895781    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-69.ec2.internal"
Sep 11 21:17:16.905282 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.905266    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-69.ec2.internal"
Sep 11 21:17:16.905344 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.905291    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-69.ec2.internal\": node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:16.946191 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.946100    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"]
Sep 11 21:17:16.946191 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.946178    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.947512 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.947489    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.947598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.947525    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.947598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.947538    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.949283 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.949270    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.949434 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.949422    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:16.949474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.949449    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.950068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.950047    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.950183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.950082    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.950183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.950097    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.950183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.950108    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.950183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.950131    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.950183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.950144    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.951374 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.951357    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:16.951456 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.951382    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:16.952077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.952063    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:16.952148 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.952085    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:16.952148 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:16.952097    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:16.963043 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.963028    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:16.982642 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.982619    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-69.ec2.internal\" not found" node="ip-10-0-136-69.ec2.internal"
Sep 11 21:17:16.987178 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:16.987161    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-69.ec2.internal\" not found" node="ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.045732 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.045705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3748a808aa5b6a616f150c39ac4532cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"3748a808aa5b6a616f150c39ac4532cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.045732 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.045736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c24e9ba836f4240933944f4d8c43e5f4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-69.ec2.internal\" (UID: \"c24e9ba836f4240933944f4d8c43e5f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.045963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.045751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3748a808aa5b6a616f150c39ac4532cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"3748a808aa5b6a616f150c39ac4532cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.063391 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:17.063355    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:17.146210 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.146179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3748a808aa5b6a616f150c39ac4532cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"3748a808aa5b6a616f150c39ac4532cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.146284 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.146220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3748a808aa5b6a616f150c39ac4532cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"3748a808aa5b6a616f150c39ac4532cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.146284 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.146238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c24e9ba836f4240933944f4d8c43e5f4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-69.ec2.internal\" (UID: \"c24e9ba836f4240933944f4d8c43e5f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.146284 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.146265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c24e9ba836f4240933944f4d8c43e5f4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-69.ec2.internal\" (UID: \"c24e9ba836f4240933944f4d8c43e5f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.146284 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.146275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3748a808aa5b6a616f150c39ac4532cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"3748a808aa5b6a616f150c39ac4532cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.146402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.146274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3748a808aa5b6a616f150c39ac4532cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"3748a808aa5b6a616f150c39ac4532cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.164320 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:17.164282    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:17.265196 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:17.265161    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:17.285282 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.285257    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.291318 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:17.291300    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:17.365759 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:17.365712    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:18.756618 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:18.756596    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:18.857238 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:18.857165    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:18.957781 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:18.957752    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:18.973937 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:18.973910    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 21:17:18.974104 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:18.974083    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 21:17:19.058121 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:19.058089    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:19.073293 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.073236    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 21:12:18 +0000 UTC" deadline="2028-03-11 10:12:24.548528468 +0000 UTC"
Sep 11 21:17:19.073293 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.073291    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13116h55m5.475243295s"
Sep 11 21:17:19.104328 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:19.104304    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3748a808aa5b6a616f150c39ac4532cd.slice/crio-03eb61145b40ee60219352140f4868b183813da9351f4912530afe4842882aa4 WatchSource:0}: Error finding container 03eb61145b40ee60219352140f4868b183813da9351f4912530afe4842882aa4: Status 404 returned error can't find the container with id 03eb61145b40ee60219352140f4868b183813da9351f4912530afe4842882aa4
Sep 11 21:17:19.104720 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:19.104702    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24e9ba836f4240933944f4d8c43e5f4.slice/crio-f6870de5a93448c124832228948aa941a378d0ea780c7ede9a4189aa996a1719 WatchSource:0}: Error finding container f6870de5a93448c124832228948aa941a378d0ea780c7ede9a4189aa996a1719: Status 404 returned error can't find the container with id f6870de5a93448c124832228948aa941a378d0ea780c7ede9a4189aa996a1719
Sep 11 21:17:19.112959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.112943    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:17:19.122565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.122547    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:17:19.123335 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.123316    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:17:19.123435 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.123350    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:17:19.123435 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.123361    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:17:19.140054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.140009    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" event={"ID":"3748a808aa5b6a616f150c39ac4532cd","Type":"ContainerStarted","Data":"03eb61145b40ee60219352140f4868b183813da9351f4912530afe4842882aa4"}
Sep 11 21:17:19.140993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.140972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" event={"ID":"c24e9ba836f4240933944f4d8c43e5f4","Type":"ContainerStarted","Data":"f6870de5a93448c124832228948aa941a378d0ea780c7ede9a4189aa996a1719"}
Sep 11 21:17:19.159152 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:19.159128    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:19.259657 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:19.259623    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:19.360360 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:19.360284    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found"
Sep 11 21:17:19.361244 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.361228    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:19.433208 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.433177    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:19.447980 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.447954    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:17:19.449989 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.449975    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"
Sep 11 21:17:19.459967 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.459954    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:17:19.471127 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.471108    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:19.554099 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:19.554048    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:20.011611 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.011576    2572 apiserver.go:52] "Watching apiserver"
Sep 11 21:17:20.019230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.019197    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 21:17:20.020604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.020572    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kml8k","kube-system/konnectivity-agent-9g98q","kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7","openshift-cluster-node-tuning-operator/tuned-knvjg","openshift-dns/node-resolver-r5wkq","openshift-multus/multus-fcmhp","openshift-multus/network-metrics-daemon-7rggl","openshift-image-registry/node-ca-97mgb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal","openshift-multus/multus-additional-cni-plugins-25sqt","openshift-network-diagnostics/network-check-target-n9v9k","openshift-network-operator/iptables-alerter-75j9n","openshift-ovn-kubernetes/ovnkube-node-tn94q"]
Sep 11 21:17:20.022383 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.022358    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.023693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.023668    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.024937 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.024918    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 21:17:20.025024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.024952    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.025479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.025461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.026222 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.026203    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.026332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.026287    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 21:17:20.026484 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.026467    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-67vfc\""
Sep 11 21:17:20.026775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.026754    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.027769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.027752    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wzts6\""
Sep 11 21:17:20.027850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.027786    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.028440 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.028189    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.028440 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.028345    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 21:17:20.028777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.028760    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.029839 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.029818    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.031557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.031537    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.032080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.032063    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 21:17:20.032846 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.032828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.032935 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.032905    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:20.033510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.033489    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 21:17:20.033586 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.033575    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.033780 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.033762    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 21:17:20.033841 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.033789    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-58xs2\""
Sep 11 21:17:20.033905 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.033767    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.033966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.033952    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.034930 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.034908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.037413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.035075    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.037413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.035915    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 21:17:20.037413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.036509    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hzt2q\""
Sep 11 21:17:20.037413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.036695    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z4rl8\""
Sep 11 21:17:20.037413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.037015    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.037734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.037572    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.037734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.037584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.037734 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.037656    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:20.037967 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.037944    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.038061 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.037985    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 21:17:20.038201 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.038179    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 21:17:20.038287 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.038240    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.038826 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.038806    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 21:17:20.039200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.039180    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 21:17:20.039331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.039315    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p7bdp\""
Sep 11 21:17:20.039402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.039393    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pgzd8\""
Sep 11 21:17:20.040347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.040327    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 21:17:20.040613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.040596    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 21:17:20.040949 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.040769    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 21:17:20.041371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.041352    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r4szf\""
Sep 11 21:17:20.041992 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.041971    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.043851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.043829    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:20.043944 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.043885    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:20.045337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-node-log\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.045427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovnkube-script-lib\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.045427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045376    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 21:17:20.045520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045377    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-device-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.045520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045494    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-cni-multus\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.045630 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36603f6d-7093-4b76-811f-0ba3b99cf1a1-konnectivity-ca\") pod \"konnectivity-agent-9g98q\" (UID: \"36603f6d-7093-4b76-811f-0ba3b99cf1a1\") " pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.045630 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-kubelet\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.045630 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-system-cni-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.045630 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045578    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysctl-d\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.045630 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30685afa-38a1-4e1d-b6e9-74d2328f180e-host\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36603f6d-7093-4b76-811f-0ba3b99cf1a1-agent-certs\") pod \"konnectivity-agent-9g98q\" (UID: \"36603f6d-7093-4b76-811f-0ba3b99cf1a1\") " pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045717    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045742    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4vkj\" (UniqueName: \"kubernetes.io/projected/78f27213-1912-4b33-a88b-dda868cf6097-kube-api-access-g4vkj\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-cnibin\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.045845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts57l\" (UniqueName: \"kubernetes.io/projected/629cb727-c26b-47b8-9bf8-f67a185ddcd4-kube-api-access-ts57l\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-systemd\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045909    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-cni-bin\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045937    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-cni-netd\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-k8s-cni-cncf-io\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/629cb727-c26b-47b8-9bf8-f67a185ddcd4-iptables-alerter-script\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.045984    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-log-socket\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9907b99-3010-4779-a367-b87094600655-cni-binary-copy\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046022    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9907b99-3010-4779-a367-b87094600655-multus-daemon-config\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-modprobe-d\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046056    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysctl-conf\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-systemd\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046100    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-etc-selinux\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-787lh\" (UniqueName: \"kubernetes.io/projected/f77ea997-b3c2-479c-a707-cb49617ac5f4-kube-api-access-787lh\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f27213-1912-4b33-a88b-dda868cf6097-tmp-dir\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.046182 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-cni-bin\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-etc-kubernetes\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046232    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-lib-modules\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-host\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-systemd-units\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046317    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rjkck\""
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-etc-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78f27213-1912-4b33-a88b-dda868cf6097-hosts-file\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-hostroot\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-env-overrides\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smjss\" (UniqueName: \"kubernetes.io/projected/efc2c130-1f22-47b3-91a1-540dbb0dde64-kube-api-access-smjss\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-sys-fs\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-kubelet\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzjh\" (UniqueName: \"kubernetes.io/projected/e9907b99-3010-4779-a367-b87094600655-kube-api-access-wrzjh\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysconfig\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-ovn\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.046883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovnkube-config\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-registration-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-cni-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-socket-dir-parent\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-tuned\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfzf\" (UniqueName: \"kubernetes.io/projected/30685afa-38a1-4e1d-b6e9-74d2328f180e-kube-api-access-2kfzf\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046744    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-multus-certs\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-slash\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046796    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-run-ovn-kubernetes\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-run\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-var-lib-kubelet\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046865    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxms4\" (UniqueName: \"kubernetes.io/projected/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-kube-api-access-dxms4\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-netns\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-conf-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.046982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f77ea997-b3c2-479c-a707-cb49617ac5f4-tmp\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.047546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovn-node-metrics-cert\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-socket-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cf12b1b-2278-4c3f-907d-2126b4406c47-kubelet-config\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cf12b1b-2278-4c3f-907d-2126b4406c47-dbus\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-var-lib-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-kubernetes\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047121    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-sys\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-run-netns\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30685afa-38a1-4e1d-b6e9-74d2328f180e-serviceca\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.048135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.047188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/629cb727-c26b-47b8-9bf8-f67a185ddcd4-host-slash\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.051331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.051305    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:17:20.082631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.082606    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l9fg4"
Sep 11 21:17:20.095890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.095865    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l9fg4"
Sep 11 21:17:20.134591 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.134556    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 21:17:20.134777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.134757    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:17:20.147500 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f27213-1912-4b33-a88b-dda868cf6097-tmp-dir\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.147685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-cni-bin\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.147685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-cni-bin\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.147685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-etc-kubernetes\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.147685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-lib-modules\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-host\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147706    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-etc-kubernetes\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-systemd-units\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-etc-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-host\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78f27213-1912-4b33-a88b-dda868cf6097-hosts-file\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzv47\" (UniqueName: \"kubernetes.io/projected/ed524755-5ece-4155-bc7f-d20e3be5c449-kube-api-access-fzv47\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147808    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-systemd-units\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147849    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-hostroot\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147828    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-etc-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-lib-modules\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147874    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78f27213-1912-4b33-a88b-dda868cf6097-hosts-file\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.147900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-env-overrides\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147890    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78f27213-1912-4b33-a88b-dda868cf6097-tmp-dir\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smjss\" (UniqueName: \"kubernetes.io/projected/efc2c130-1f22-47b3-91a1-540dbb0dde64-kube-api-access-smjss\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-sys-fs\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148010    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.147919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-hostroot\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-kubelet\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148075    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-sys-fs\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148064    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzjh\" (UniqueName: \"kubernetes.io/projected/e9907b99-3010-4779-a367-b87094600655-kube-api-access-wrzjh\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-kubelet\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysconfig\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148153    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-ovn\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovnkube-config\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148206    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-registration-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysconfig\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-ovn\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-cni-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.148572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-socket-dir-parent\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148300    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-registration-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-tuned\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-cni-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148376    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-socket-dir-parent\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfzf\" (UniqueName: \"kubernetes.io/projected/30685afa-38a1-4e1d-b6e9-74d2328f180e-kube-api-access-2kfzf\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148503    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-env-overrides\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148556    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-multus-certs\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148618    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-multus-certs\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-slash\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-slash\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-run-ovn-kubernetes\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148708    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-run-ovn-kubernetes\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148715    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-run\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-var-lib-kubelet\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:20.149402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148802    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovnkube-config\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxms4\" (UniqueName: \"kubernetes.io/projected/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-kube-api-access-dxms4\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148830    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-run\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148834    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-var-lib-kubelet\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-netns\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.148953    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-conf-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.148991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f77ea997-b3c2-479c-a707-cb49617ac5f4-tmp\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovn-node-metrics-cert\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149025    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-netns\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.149073    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:20.649024563 +0000 UTC m=+2.961249922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149075    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-multus-conf-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149101    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-socket-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cf12b1b-2278-4c3f-907d-2126b4406c47-kubelet-config\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149234    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cf12b1b-2278-4c3f-907d-2126b4406c47-dbus\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-var-lib-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149338    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cf12b1b-2278-4c3f-907d-2126b4406c47-kubelet-config\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149343    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-var-lib-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149372    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cf12b1b-2278-4c3f-907d-2126b4406c47-dbus\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-kubernetes\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-sys\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-run-netns\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30685afa-38a1-4e1d-b6e9-74d2328f180e-serviceca\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-kubernetes\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149538    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-run-netns\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-sys\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149571    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-socket-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/629cb727-c26b-47b8-9bf8-f67a185ddcd4-host-slash\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-node-log\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovnkube-script-lib\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/629cb727-c26b-47b8-9bf8-f67a185ddcd4-host-slash\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-device-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-cni-multus\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.150872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149703    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-node-log\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-var-lib-cni-multus\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149733    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149802    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-device-dir\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36603f6d-7093-4b76-811f-0ba3b99cf1a1-konnectivity-ca\") pod \"konnectivity-agent-9g98q\" (UID: \"36603f6d-7093-4b76-811f-0ba3b99cf1a1\") " pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30685afa-38a1-4e1d-b6e9-74d2328f180e-serviceca\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-kubelet\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-system-cni-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-kubelet\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysctl-d\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.149993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30685afa-38a1-4e1d-b6e9-74d2328f180e-host\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-system-cni-dir\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36603f6d-7093-4b76-811f-0ba3b99cf1a1-agent-certs\") pod \"konnectivity-agent-9g98q\" (UID: \"36603f6d-7093-4b76-811f-0ba3b99cf1a1\") " pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150055    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30685afa-38a1-4e1d-b6e9-74d2328f180e-host\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150065    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vkj\" (UniqueName: \"kubernetes.io/projected/78f27213-1912-4b33-a88b-dda868cf6097-kube-api-access-g4vkj\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-cnibin\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.151749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150128    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-openvswitch\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150169    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z95s\" (UniqueName: \"kubernetes.io/projected/b1b32e1f-fea6-4c4f-b388-80205d64861b-kube-api-access-4z95s\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts57l\" (UniqueName: \"kubernetes.io/projected/629cb727-c26b-47b8-9bf8-f67a185ddcd4-kube-api-access-ts57l\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150241    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-systemd\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150311    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovnkube-script-lib\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-cni-bin\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150097    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysctl-d\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-cni-netd\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-k8s-cni-cncf-io\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150374    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150400    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-system-cni-dir\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150392    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-cnibin\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150445    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-cni-bin\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150460    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-host-cni-netd\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9907b99-3010-4779-a367-b87094600655-host-run-k8s-cni-cncf-io\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/36603f6d-7093-4b76-811f-0ba3b99cf1a1-konnectivity-ca\") pod \"konnectivity-agent-9g98q\" (UID: \"36603f6d-7093-4b76-811f-0ba3b99cf1a1\") " pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150546    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-run-systemd\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.152639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-cnibin\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150588    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/629cb727-c26b-47b8-9bf8-f67a185ddcd4-iptables-alerter-script\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-log-socket\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9907b99-3010-4779-a367-b87094600655-cni-binary-copy\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9907b99-3010-4779-a367-b87094600655-multus-daemon-config\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150704    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/efc2c130-1f22-47b3-91a1-540dbb0dde64-log-socket\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-modprobe-d\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysctl-conf\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150757    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-systemd\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-cni-binary-copy\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150815    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-etc-selinux\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-787lh\" (UniqueName: \"kubernetes.io/projected/f77ea997-b3c2-479c-a707-cb49617ac5f4-kube-api-access-787lh\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.150856    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151165    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/629cb727-c26b-47b8-9bf8-f67a185ddcd4-iptables-alerter-script\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-systemd\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9907b99-3010-4779-a367-b87094600655-cni-binary-copy\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151330    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-modprobe-d\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.153453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151376    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-sysctl-conf\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.154186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-etc-selinux\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.154186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.151403    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9907b99-3010-4779-a367-b87094600655-multus-daemon-config\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.155549 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.155510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f77ea997-b3c2-479c-a707-cb49617ac5f4-tmp\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.155646 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.155549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f77ea997-b3c2-479c-a707-cb49617ac5f4-etc-tuned\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.155892 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.155869    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/efc2c130-1f22-47b3-91a1-540dbb0dde64-ovn-node-metrics-cert\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.156132 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.156114    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/36603f6d-7093-4b76-811f-0ba3b99cf1a1-agent-certs\") pod \"konnectivity-agent-9g98q\" (UID: \"36603f6d-7093-4b76-811f-0ba3b99cf1a1\") " pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.158428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.158396    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzjh\" (UniqueName: \"kubernetes.io/projected/e9907b99-3010-4779-a367-b87094600655-kube-api-access-wrzjh\") pod \"multus-fcmhp\" (UID: \"e9907b99-3010-4779-a367-b87094600655\") " pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.158744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.158717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfzf\" (UniqueName: \"kubernetes.io/projected/30685afa-38a1-4e1d-b6e9-74d2328f180e-kube-api-access-2kfzf\") pod \"node-ca-97mgb\" (UID: \"30685afa-38a1-4e1d-b6e9-74d2328f180e\") " pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.159222 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.159197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts57l\" (UniqueName: \"kubernetes.io/projected/629cb727-c26b-47b8-9bf8-f67a185ddcd4-kube-api-access-ts57l\") pod \"iptables-alerter-75j9n\" (UID: \"629cb727-c26b-47b8-9bf8-f67a185ddcd4\") " pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.159865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.159844    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxms4\" (UniqueName: \"kubernetes.io/projected/a913c3bd-5ab1-47bd-893e-9acd81dc3e4a-kube-api-access-dxms4\") pod \"aws-ebs-csi-driver-node-fskc7\" (UID: \"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.160223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.160204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smjss\" (UniqueName: \"kubernetes.io/projected/efc2c130-1f22-47b3-91a1-540dbb0dde64-kube-api-access-smjss\") pod \"ovnkube-node-tn94q\" (UID: \"efc2c130-1f22-47b3-91a1-540dbb0dde64\") " pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.160576 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.160555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vkj\" (UniqueName: \"kubernetes.io/projected/78f27213-1912-4b33-a88b-dda868cf6097-kube-api-access-g4vkj\") pod \"node-resolver-r5wkq\" (UID: \"78f27213-1912-4b33-a88b-dda868cf6097\") " pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.160828 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.160799    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-787lh\" (UniqueName: \"kubernetes.io/projected/f77ea997-b3c2-479c-a707-cb49617ac5f4-kube-api-access-787lh\") pod \"tuned-knvjg\" (UID: \"f77ea997-b3c2-479c-a707-cb49617ac5f4\") " pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.251837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.251801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.251848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z95s\" (UniqueName: \"kubernetes.io/projected/b1b32e1f-fea6-4c4f-b388-80205d64861b-kube-api-access-4z95s\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.252023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.251877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-system-cni-dir\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.251942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-cnibin\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.251972    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-cni-binary-copy\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.251999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzv47\" (UniqueName: \"kubernetes.io/projected/ed524755-5ece-4155-bc7f-d20e3be5c449-kube-api-access-fzv47\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252026    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-system-cni-dir\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252089    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-cnibin\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.252237    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:20.252357 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.252319    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:17:20.752299191 +0000 UTC m=+3.064524540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:20.252688 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252046    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed524755-5ece-4155-bc7f-d20e3be5c449-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252797 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.252970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.252953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-cni-binary-copy\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.253106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.253089    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed524755-5ece-4155-bc7f-d20e3be5c449-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.264399 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.264333    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:20.264399 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.264362    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:20.264399 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.264378    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:20.264399 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.264393    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z95s\" (UniqueName: \"kubernetes.io/projected/b1b32e1f-fea6-4c4f-b388-80205d64861b-kube-api-access-4z95s\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.264661 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.264455    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:17:20.764435275 +0000 UTC m=+3.076660636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:20.267215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.267195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzv47\" (UniqueName: \"kubernetes.io/projected/ed524755-5ece-4155-bc7f-d20e3be5c449-kube-api-access-fzv47\") pod \"multus-additional-cni-plugins-25sqt\" (UID: \"ed524755-5ece-4155-bc7f-d20e3be5c449\") " pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.337804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.337765    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcmhp"
Sep 11 21:17:20.345883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.345849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-75j9n"
Sep 11 21:17:20.357743 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.357716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:20.362178 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.362160    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7"
Sep 11 21:17:20.370016 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.370000    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-knvjg"
Sep 11 21:17:20.376580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.376552    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r5wkq"
Sep 11 21:17:20.384099 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.384075    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97mgb"
Sep 11 21:17:20.391865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.391845    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:20.397288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.397269    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25sqt"
Sep 11 21:17:20.654368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.654286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:20.654530 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.654439    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:20.654530 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.654509    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:21.654492777 +0000 UTC m=+3.966718140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:20.754884 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.754845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:20.755054 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.755001    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:20.755108 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.755066    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:17:21.755051776 +0000 UTC m=+4.067277120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:20.855477 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:20.855434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:20.855656 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.855600    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:20.855656 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.855620    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:20.855656 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.855633    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:20.855804 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:20.855698    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:17:21.855680671 +0000 UTC m=+4.167906085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:20.952543 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:20.952202    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded524755_5ece_4155_bc7f_d20e3be5c449.slice/crio-2dc2997972217b5468ef4594c07309ad1d8b823081563c17d2494b6b5241d7d8 WatchSource:0}: Error finding container 2dc2997972217b5468ef4594c07309ad1d8b823081563c17d2494b6b5241d7d8: Status 404 returned error can't find the container with id 2dc2997972217b5468ef4594c07309ad1d8b823081563c17d2494b6b5241d7d8
Sep 11 21:17:20.952846 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:20.952787    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9907b99_3010_4779_a367_b87094600655.slice/crio-0e209154c15f8254b7af4dfb739b23c1116a5992c2e8a67ea27a3f6b2dcbf386 WatchSource:0}: Error finding container 0e209154c15f8254b7af4dfb739b23c1116a5992c2e8a67ea27a3f6b2dcbf386: Status 404 returned error can't find the container with id 0e209154c15f8254b7af4dfb739b23c1116a5992c2e8a67ea27a3f6b2dcbf386
Sep 11 21:17:20.954603 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:20.954574    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629cb727_c26b_47b8_9bf8_f67a185ddcd4.slice/crio-13bcfeac0342ba23913b5ebeb485ae47162b83203f483c978050e49ff54bcdb8 WatchSource:0}: Error finding container 13bcfeac0342ba23913b5ebeb485ae47162b83203f483c978050e49ff54bcdb8: Status 404 returned error can't find the container with id 13bcfeac0342ba23913b5ebeb485ae47162b83203f483c978050e49ff54bcdb8
Sep 11 21:17:20.956063 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:20.955950    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77ea997_b3c2_479c_a707_cb49617ac5f4.slice/crio-c8a9398aef7c3e6bd814cacbe080d020c42f008c146aa4f8695b76480c96c5b6 WatchSource:0}: Error finding container c8a9398aef7c3e6bd814cacbe080d020c42f008c146aa4f8695b76480c96c5b6: Status 404 returned error can't find the container with id c8a9398aef7c3e6bd814cacbe080d020c42f008c146aa4f8695b76480c96c5b6
Sep 11 21:17:20.958656 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:20.958633    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc2c130_1f22_47b3_91a1_540dbb0dde64.slice/crio-9bfbde17cfe2aaea99fcd46f64b297ade2f5e4302a4c5e336de0c3b87b768018 WatchSource:0}: Error finding container 9bfbde17cfe2aaea99fcd46f64b297ade2f5e4302a4c5e336de0c3b87b768018: Status 404 returned error can't find the container with id 9bfbde17cfe2aaea99fcd46f64b297ade2f5e4302a4c5e336de0c3b87b768018
Sep 11 21:17:21.098365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.098312    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:12:20 +0000 UTC" deadline="2028-03-31 20:35:13.932988007 +0000 UTC"
Sep 11 21:17:21.098365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.098361    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13607h17m52.834630983s"
Sep 11 21:17:21.145889 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.145855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcmhp" event={"ID":"e9907b99-3010-4779-a367-b87094600655","Type":"ContainerStarted","Data":"0e209154c15f8254b7af4dfb739b23c1116a5992c2e8a67ea27a3f6b2dcbf386"}
Sep 11 21:17:21.147373 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.147342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-75j9n" event={"ID":"629cb727-c26b-47b8-9bf8-f67a185ddcd4","Type":"ContainerStarted","Data":"13bcfeac0342ba23913b5ebeb485ae47162b83203f483c978050e49ff54bcdb8"}
Sep 11 21:17:21.148504 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.148477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerStarted","Data":"2dc2997972217b5468ef4594c07309ad1d8b823081563c17d2494b6b5241d7d8"}
Sep 11 21:17:21.150544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.150507    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" event={"ID":"c24e9ba836f4240933944f4d8c43e5f4","Type":"ContainerStarted","Data":"2729c1ec7dc3e09bd6aa79a364f6bf3b138032423369f730acd1690b45d6af6d"}
Sep 11 21:17:21.151967 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.151942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7" event={"ID":"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a","Type":"ContainerStarted","Data":"885ef87ea5537c32d911ed88a6697d2e5f2f143122cf7fcdbe6e049ef3a27df1"}
Sep 11 21:17:21.153137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.153117    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9g98q" event={"ID":"36603f6d-7093-4b76-811f-0ba3b99cf1a1","Type":"ContainerStarted","Data":"3195301dd331aa591c0abe811ba07667fd3f1d8f40feae56b2ab32630bf3741a"}
Sep 11 21:17:21.154422 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.154399    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"9bfbde17cfe2aaea99fcd46f64b297ade2f5e4302a4c5e336de0c3b87b768018"}
Sep 11 21:17:21.155588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.155568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-knvjg" event={"ID":"f77ea997-b3c2-479c-a707-cb49617ac5f4","Type":"ContainerStarted","Data":"c8a9398aef7c3e6bd814cacbe080d020c42f008c146aa4f8695b76480c96c5b6"}
Sep 11 21:17:21.156810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.156783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97mgb" event={"ID":"30685afa-38a1-4e1d-b6e9-74d2328f180e","Type":"ContainerStarted","Data":"d0438f753c2f1377a6b8ec7957b5a07fd00a697e846b887801dff6b5bf32a7b9"}
Sep 11 21:17:21.157891 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.157868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5wkq" event={"ID":"78f27213-1912-4b33-a88b-dda868cf6097","Type":"ContainerStarted","Data":"773e3abf39ad80d423d44f271764f454d06511e0c3e7605faa88db3f33f461d2"}
Sep 11 21:17:21.171188 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.171144    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" podStartSLOduration=2.171131834 podStartE2EDuration="2.171131834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:21.170586202 +0000 UTC m=+3.482811569" watchObservedRunningTime="2026-09-11 21:17:21.171131834 +0000 UTC m=+3.483357199"
Sep 11 21:17:21.661343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.661295    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:21.661508 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.661438    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:21.661508 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.661498    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:23.661481645 +0000 UTC m=+5.973707003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:21.762525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.762487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:21.762707 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.762633    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:21.762707 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.762694    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:17:23.762677591 +0000 UTC m=+6.074902936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:21.864094 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:21.863471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:21.864094 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.863637    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:21.864094 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.863658    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:21.864094 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.863671    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:21.864094 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:21.863731    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:17:23.863710897 +0000 UTC m=+6.175936266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:22.099559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.099513    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:12:20 +0000 UTC" deadline="2028-04-15 04:50:53.892616649 +0000 UTC"
Sep 11 21:17:22.099559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.099557    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13951h33m31.793064904s"
Sep 11 21:17:22.139279 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.139232    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:22.139461 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:22.139387    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:22.139859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.139838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:22.140013 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:22.139990    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:22.140077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.140068    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:22.140166 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:22.140138    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:22.175217 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.175184    2572 generic.go:356] "Generic (PLEG): container finished" podID="3748a808aa5b6a616f150c39ac4532cd" containerID="828364fc50e5a1c378c61fb090b752cd9a7010febbd1b821d2a21cf97cf4d302" exitCode=0
Sep 11 21:17:22.176122 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:22.176095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" event={"ID":"3748a808aa5b6a616f150c39ac4532cd","Type":"ContainerDied","Data":"828364fc50e5a1c378c61fb090b752cd9a7010febbd1b821d2a21cf97cf4d302"}
Sep 11 21:17:23.184986 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:23.184307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" event={"ID":"3748a808aa5b6a616f150c39ac4532cd","Type":"ContainerStarted","Data":"5bfddbd2af3efdf455e9fe8a101e371d6ffbb03c575ed67f9c17e72e51b58960"}
Sep 11 21:17:23.203827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:23.203668    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" podStartSLOduration=4.203646399 podStartE2EDuration="4.203646399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:23.202569005 +0000 UTC m=+5.514794371" watchObservedRunningTime="2026-09-11 21:17:23.203646399 +0000 UTC m=+5.515871765"
Sep 11 21:17:23.682310 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:23.681703    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:23.682310 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.681870    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:23.682310 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.681931    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:27.681913745 +0000 UTC m=+9.994139105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:23.783136 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:23.782513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:23.783136 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.782736    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:23.783136 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.782801    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:17:27.782783613 +0000 UTC m=+10.095008976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:23.883283 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:23.883028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:23.883283 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.883241    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:23.883283 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.883275    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:23.883283 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.883288    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:23.883629 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:23.883347    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:17:27.883329562 +0000 UTC m=+10.195554912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:24.137396 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:24.137363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:24.137396 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:24.137401    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:24.137654 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:24.137363    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:24.137654 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:24.137495    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:24.137654 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:24.137585    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:24.137809 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:24.137664    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:26.139395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:26.138410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:26.139395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:26.138427    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:26.139395 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:26.138625    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:26.139395 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:26.138723    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:26.139395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:26.138774    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:26.139395 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:26.138858    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:27.714494 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:27.714459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:27.714935 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.714622    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:27.714935 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.714692    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:35.714675257 +0000 UTC m=+18.026900600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:27.814896 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:27.814866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:27.815083 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.815014    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:27.815083 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.815083    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:17:35.815064416 +0000 UTC m=+18.127289781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:27.916054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:27.915855    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:27.916390 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.916364    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:27.916503 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.916400    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:27.916503 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.916420    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:27.916606 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:27.916521    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:17:35.916500309 +0000 UTC m=+18.228725667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:28.137110 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:28.137075    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:28.137110 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:28.137074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:28.138347 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:28.138315    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:28.138465 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:28.138380    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:28.138465 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:28.138417    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:28.138573 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:28.138532    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:30.137898 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:30.137698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:30.138352 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:30.138034    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:30.138426 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:30.138410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:30.138520 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:30.138498    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:30.138671 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:30.138646    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:30.138779 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:30.138735    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:32.137029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:32.136990    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:32.137029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:32.137032    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:32.137469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:32.136995    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:32.137469 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:32.137120    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:32.137469 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:32.137222    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:32.137469 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:32.137305    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:34.137479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:34.137446    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:34.137903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:34.137450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:34.137903 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:34.137575    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:34.137903 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:34.137678    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:34.137903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:34.137707    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:34.137903 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:34.137787    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:35.773146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:35.773110    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:35.773598 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.773265    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:35.773598 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.773346    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:51.773324727 +0000 UTC m=+34.085550092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:35.874267 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:35.874217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:35.874450 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.874377    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:35.874503 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.874455    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:17:51.874432141 +0000 UTC m=+34.186657533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:35.974655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:35.974620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:35.974832 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.974781    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:35.974832 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.974798    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:35.974832 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.974808    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:35.974983 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:35.974858    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:17:51.974843845 +0000 UTC m=+34.287069191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:36.137653 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:36.137522    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:36.137653 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:36.137558    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:36.137868 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:36.137673    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:36.137868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:36.137762    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:36.137868 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:36.137754    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:36.137868 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:36.137857    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:38.137652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:38.137617    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:38.138130 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:38.137721    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:38.138130 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:38.137819    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:38.138130 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:38.137976    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:38.138130 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:38.137984    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:38.138130 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:38.138064    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:39.217546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.217370    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed524755-5ece-4155-bc7f-d20e3be5c449" containerID="c869effc6034a3181a916bb4f4570e971ee0487d2d9ae865fb49cdfcee7b9c1e" exitCode=0
Sep 11 21:17:39.218503 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.217436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerDied","Data":"c869effc6034a3181a916bb4f4570e971ee0487d2d9ae865fb49cdfcee7b9c1e"}
Sep 11 21:17:39.219790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.219763    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7" event={"ID":"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a","Type":"ContainerStarted","Data":"fa2c406bc23f0e560c6f0b69d66e2d064e9181efb4d1cfdbada86cc1e51a9103"}
Sep 11 21:17:39.221423 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.221393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9g98q" event={"ID":"36603f6d-7093-4b76-811f-0ba3b99cf1a1","Type":"ContainerStarted","Data":"2d989293ada54a860ffd344f08095ae089fe5d4f12a7f618aaddd59e90515381"}
Sep 11 21:17:39.225670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.225636    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"1130d9244d840953925217aef363b437c3ba04f62eae18dd18490223f93ced0e"}
Sep 11 21:17:39.225766 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.225712    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"bedddeb85ada4dd96c6aa504365141909799af8dd2f8273bccc298bc59263a7d"}
Sep 11 21:17:39.225766 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.225759    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"ab22c4356afcfcf30c46da016d93501bc4b8bf725986d6e07793a8b337bd731b"}
Sep 11 21:17:39.225880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.225789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"bcac88323b6437a0fc8658444c93e3af9cda397f76c734611c6e7157e6abb1c4"}
Sep 11 21:17:39.225880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.225827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"a0cbacc5d831a4690a887903a24ea9776929e4a0d4c3fec899a1768345eb7805"}
Sep 11 21:17:39.225880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.225860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"fafe988750aa7bbd4d79870484d2777f802d8408dc325afa48c4dbc4f539641d"}
Sep 11 21:17:39.227326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.227306    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-knvjg" event={"ID":"f77ea997-b3c2-479c-a707-cb49617ac5f4","Type":"ContainerStarted","Data":"f3891af6c30f1c9d59470f0fdb9de363db934ee8f07b1258b283b119861a6dc7"}
Sep 11 21:17:39.228807 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.228789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97mgb" event={"ID":"30685afa-38a1-4e1d-b6e9-74d2328f180e","Type":"ContainerStarted","Data":"8f0a0d70afeb8bb7710d622e7da69f446375e729fde9c76b977eb21bdcd2b420"}
Sep 11 21:17:39.230373 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.230343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r5wkq" event={"ID":"78f27213-1912-4b33-a88b-dda868cf6097","Type":"ContainerStarted","Data":"b18b5ee7baa64f0aab9a7cf26c53751b2b0d9a01e835a9f7b5f69b043b9afcfd"}
Sep 11 21:17:39.231878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.231860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcmhp" event={"ID":"e9907b99-3010-4779-a367-b87094600655","Type":"ContainerStarted","Data":"fed8928d1d9847b1b7d711509e21113673c0421a76cfa65e1965e8c99d14b801"}
Sep 11 21:17:39.254099 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.254038    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r5wkq" podStartSLOduration=3.623827071 podStartE2EDuration="21.254022733s" totalImagesPullingTime="17.630195662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:39.253988875 +0000 UTC m=+21.566214242" watchObservedRunningTime="2026-09-11 21:17:39.254022733 +0000 UTC m=+21.566248099"
Sep 11 21:17:39.268358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.268313    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-97mgb" podStartSLOduration=3.648674005 podStartE2EDuration="21.268299125s" totalImagesPullingTime="17.61962512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:39.267938068 +0000 UTC m=+21.580163433" watchObservedRunningTime="2026-09-11 21:17:39.268299125 +0000 UTC m=+21.580524491"
Sep 11 21:17:39.282963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.282920    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fcmhp" podStartSLOduration=3.598719204 podStartE2EDuration="21.282905047s" totalImagesPullingTime="17.684185843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:39.282821045 +0000 UTC m=+21.595046410" watchObservedRunningTime="2026-09-11 21:17:39.282905047 +0000 UTC m=+21.595130413"
Sep 11 21:17:39.307076 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:39.307031    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-knvjg" podStartSLOduration=3.6829249859999997 podStartE2EDuration="21.307016737s" totalImagesPullingTime="17.624091751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:39.306222124 +0000 UTC m=+21.618447489" watchObservedRunningTime="2026-09-11 21:17:39.307016737 +0000 UTC m=+21.619242116"
Sep 11 21:17:40.137840 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.137585    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:40.138096 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.137597    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:40.138381 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:40.138190    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:40.138381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.137585    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:40.138381 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:40.138240    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:40.138381 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:40.138338    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:40.235929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.235889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-75j9n" event={"ID":"629cb727-c26b-47b8-9bf8-f67a185ddcd4","Type":"ContainerStarted","Data":"17f03d109d8c9ab3233e636c6fd6868802ae620004ffe36f663627b8d863ec81"}
Sep 11 21:17:40.252366 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.252308    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-75j9n" podStartSLOduration=4.621797241 podStartE2EDuration="22.252288496s" totalImagesPullingTime="17.630491255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:40.252189316 +0000 UTC m=+22.564414682" watchObservedRunningTime="2026-09-11 21:17:40.252288496 +0000 UTC m=+22.564513861"
Sep 11 21:17:40.252651 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.252623    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9g98q" podStartSLOduration=4.641627282 podStartE2EDuration="22.252613669s" totalImagesPullingTime="17.610986387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:39.340582059 +0000 UTC m=+21.652807424" watchObservedRunningTime="2026-09-11 21:17:40.252613669 +0000 UTC m=+22.564839036"
Sep 11 21:17:40.257369 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:40.257347    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 21:17:41.094480 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:41.094348    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T21:17:40.257366126Z","UUID":"d73edd72-d2cf-4b1e-aefa-3f647e7a0c04","Handler":null,"Name":"","Endpoint":""}
Sep 11 21:17:41.096816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:41.096788    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 21:17:41.096959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:41.096826    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 21:17:41.241775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:41.241674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7" event={"ID":"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a","Type":"ContainerStarted","Data":"bdf1f1e683f3234719a40ff68bb1a583e7e07caf46b6e6a4291ccd3fb0d4e071"}
Sep 11 21:17:42.055339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.055271    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:42.056060 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.056038    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:42.136563 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.136524    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:42.136748 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.136647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:42.136748 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:42.136654    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:42.136748 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:42.136730    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:42.136927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.136789    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:42.136927 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:42.136869    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:42.247006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.246971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7" event={"ID":"a913c3bd-5ab1-47bd-893e-9acd81dc3e4a","Type":"ContainerStarted","Data":"af6dfd57f323c969e842414e6d14bee25a58b9d49be641040eac0ebd86dae874"}
Sep 11 21:17:42.251007 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.250975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"0129f6aa76d879171fdd5a51df6a7d3c06b1c7501257e7e29edff9fd19a45847"}
Sep 11 21:17:42.251164 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.251147    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:42.251659 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.251642    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9g98q"
Sep 11 21:17:42.264553 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:42.264504    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fskc7" podStartSLOduration=4.168756881 podStartE2EDuration="24.264490626s" totalImagesPullingTime="20.095733745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:42.264269399 +0000 UTC m=+24.576494765" watchObservedRunningTime="2026-09-11 21:17:42.264490626 +0000 UTC m=+24.576715990"
Sep 11 21:17:44.136973 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.136778    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:44.137491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.136783    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:44.137491 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:44.137073    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:44.137491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.136807    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:44.137491 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:44.137193    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:44.137491 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:44.137305    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:44.258944 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.258905    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" event={"ID":"efc2c130-1f22-47b3-91a1-540dbb0dde64","Type":"ContainerStarted","Data":"dc1ee6c20c49ca8f32f81098414d1e14fc203d25ba0bc6591dd40c20719459f9"}
Sep 11 21:17:44.259185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.259164    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:44.259282 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.259273    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:44.259334 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.259309    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:44.261020 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.260991    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed524755-5ece-4155-bc7f-d20e3be5c449" containerID="be8d72f53784be4cd5983371ab2120f70b8323a7d16ab74f58185be5f7c3f5a0" exitCode=0
Sep 11 21:17:44.261116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.261069    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerDied","Data":"be8d72f53784be4cd5983371ab2120f70b8323a7d16ab74f58185be5f7c3f5a0"}
Sep 11 21:17:44.275087 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.275066    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:44.275193 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.275158    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:17:44.289604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:44.289563    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q" podStartSLOduration=8.611976828 podStartE2EDuration="26.289549185s" totalImagesPullingTime="17.677572357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:44.289386917 +0000 UTC m=+26.601612283" watchObservedRunningTime="2026-09-11 21:17:44.289549185 +0000 UTC m=+26.601774550"
Sep 11 21:17:45.980092 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:45.980053    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kml8k"]
Sep 11 21:17:45.980971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:45.980165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:45.980971 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:45.980269    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:45.983033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:45.983007    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rggl"]
Sep 11 21:17:45.983180 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:45.983122    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:45.983239 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:45.983221    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:45.983691 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:45.983670    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9v9k"]
Sep 11 21:17:45.983758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:45.983749    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:45.983827 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:45.983811    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:46.268294 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:46.268261    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed524755-5ece-4155-bc7f-d20e3be5c449" containerID="52b7b59d8ed48288e9b0c06c5fd17a685303b06bd5ddb8e02b924d96af36ed05" exitCode=0
Sep 11 21:17:46.268439 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:46.268343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerDied","Data":"52b7b59d8ed48288e9b0c06c5fd17a685303b06bd5ddb8e02b924d96af36ed05"}
Sep 11 21:17:47.137109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:47.137070    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:47.137546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:47.137092    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:47.137546 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:47.137209    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:47.137546 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:47.137282    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:47.273061 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:47.272974    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed524755-5ece-4155-bc7f-d20e3be5c449" containerID="da605b3b8bf78b0756767dca6f601b054244731ed506f4eb7ccdc1be2c7a04ac" exitCode=0
Sep 11 21:17:47.273061 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:47.273028    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerDied","Data":"da605b3b8bf78b0756767dca6f601b054244731ed506f4eb7ccdc1be2c7a04ac"}
Sep 11 21:17:48.138726 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:48.138500    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:48.139163 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:48.138805    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:49.137023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:49.136988    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:49.137237 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:49.137110    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:49.137237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:49.137209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:49.137392 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:49.137369    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:50.137466 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:50.137435    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:50.137817 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:50.137556    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kml8k" podUID="4cf12b1b-2278-4c3f-907d-2126b4406c47"
Sep 11 21:17:51.137342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.137300    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:51.137342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.137329    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:51.137902 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.137458    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rggl" podUID="b1b32e1f-fea6-4c4f-b388-80205d64861b"
Sep 11 21:17:51.137902 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.137533    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9v9k" podUID="9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf"
Sep 11 21:17:51.519850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.519818    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeReady"
Sep 11 21:17:51.520016 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.519973    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 21:17:51.563291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.563244    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-844bf8659c-w2s47"]
Sep 11 21:17:51.570063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.570037    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.572767 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.572731    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 21:17:51.572904 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.572731    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 21:17:51.572904 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.572791    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xvbfg\""
Sep 11 21:17:51.573018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.573002    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 21:17:51.581377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.579719    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 21:17:51.584730 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.584590    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844bf8659c-w2s47"]
Sep 11 21:17:51.585312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.585294    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j94n7"]
Sep 11 21:17:51.600580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.600559    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z2lpr"]
Sep 11 21:17:51.600699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.600681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.603444 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.603422    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 21:17:51.603555 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.603465    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdgmr\""
Sep 11 21:17:51.603555 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.603466    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 21:17:51.610850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.610828    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j94n7"]
Sep 11 21:17:51.610954 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.610871    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z2lpr"]
Sep 11 21:17:51.610954 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.610944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.613741 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.613551    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 21:17:51.613741 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.613551    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 21:17:51.613921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.613852    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ld6cs\""
Sep 11 21:17:51.614047 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.614026    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 21:17:51.683999 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.683919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-image-registry-private-configuration\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.683999 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.683958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.683999 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.683985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-trusted-ca\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.684209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684034    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866539c7-de3c-4623-a54c-d189a08dfc42-tmp-dir\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.684209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d7fn\" (UniqueName: \"kubernetes.io/projected/fde79141-414e-4126-b217-fcbb5dd41abf-kube-api-access-9d7fn\") pod \"ingress-canary-z2lpr\" (UID: \"fde79141-414e-4126-b217-fcbb5dd41abf\") " pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.684209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/866539c7-de3c-4623-a54c-d189a08dfc42-config-volume\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.684209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e14b95a-2f45-4180-9237-540c64a8da0d-ca-trust-extracted\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.684209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-installation-pull-secrets\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.684415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.684415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684308    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g2m8\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-kube-api-access-5g2m8\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.684415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684335    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-bound-sa-token\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.684415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4r7\" (UniqueName: \"kubernetes.io/projected/866539c7-de3c-4623-a54c-d189a08dfc42-kube-api-access-dq4r7\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.684415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-certificates\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.684415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.684404    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fde79141-414e-4126-b217-fcbb5dd41abf-cert\") pod \"ingress-canary-z2lpr\" (UID: \"fde79141-414e-4126-b217-fcbb5dd41abf\") " pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.722811 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.722776    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:51.784942 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.784907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.785079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.784965    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g2m8\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-kube-api-access-5g2m8\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.784995    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-bound-sa-token\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785017    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4r7\" (UniqueName: \"kubernetes.io/projected/866539c7-de3c-4623-a54c-d189a08dfc42-kube-api-access-dq4r7\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.785079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-certificates\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785079 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.785067    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:51.785319 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.785143    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls podName:866539c7-de3c-4623-a54c-d189a08dfc42 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:52.285124948 +0000 UTC m=+34.597350302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls") pod "dns-default-j94n7" (UID: "866539c7-de3c-4623-a54c-d189a08dfc42") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:51.785319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fde79141-414e-4126-b217-fcbb5dd41abf-cert\") pod \"ingress-canary-z2lpr\" (UID: \"fde79141-414e-4126-b217-fcbb5dd41abf\") " pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.785319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-image-registry-private-configuration\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-trusted-ca\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866539c7-de3c-4623-a54c-d189a08dfc42-tmp-dir\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d7fn\" (UniqueName: \"kubernetes.io/projected/fde79141-414e-4126-b217-fcbb5dd41abf-kube-api-access-9d7fn\") pod \"ingress-canary-z2lpr\" (UID: \"fde79141-414e-4126-b217-fcbb5dd41abf\") " pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/866539c7-de3c-4623-a54c-d189a08dfc42-config-volume\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.785418    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.785432    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844bf8659c-w2s47: secret "image-registry-tls" not found
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.785477    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls podName:6e14b95a-2f45-4180-9237-540c64a8da0d nodeName:}" failed. No retries permitted until 2026-09-11 21:17:52.28546223 +0000 UTC m=+34.597687595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls") pod "image-registry-844bf8659c-w2s47" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d") : secret "image-registry-tls" not found
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e14b95a-2f45-4180-9237-540c64a8da0d-ca-trust-extracted\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785538    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:51.785959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-installation-pull-secrets\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.785959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785769    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-certificates\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.786065 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.785977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e14b95a-2f45-4180-9237-540c64a8da0d-ca-trust-extracted\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.786065 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.786025    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866539c7-de3c-4623-a54c-d189a08dfc42-tmp-dir\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.786169 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.786068    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:51.786169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.786069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/866539c7-de3c-4623-a54c-d189a08dfc42-config-volume\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.786169 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.786127    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret podName:4cf12b1b-2278-4c3f-907d-2126b4406c47 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:23.786109833 +0000 UTC m=+66.098335195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret") pod "global-pull-secret-syncer-kml8k" (UID: "4cf12b1b-2278-4c3f-907d-2126b4406c47") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:17:51.786373 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.786356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-trusted-ca\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.789068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.789048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-installation-pull-secrets\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.789183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.789125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-image-registry-private-configuration\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.789265 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.789180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fde79141-414e-4126-b217-fcbb5dd41abf-cert\") pod \"ingress-canary-z2lpr\" (UID: \"fde79141-414e-4126-b217-fcbb5dd41abf\") " pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.795360 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.795329    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d7fn\" (UniqueName: \"kubernetes.io/projected/fde79141-414e-4126-b217-fcbb5dd41abf-kube-api-access-9d7fn\") pod \"ingress-canary-z2lpr\" (UID: \"fde79141-414e-4126-b217-fcbb5dd41abf\") " pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.795486 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.795453    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g2m8\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-kube-api-access-5g2m8\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.795633 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.795608    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4r7\" (UniqueName: \"kubernetes.io/projected/866539c7-de3c-4623-a54c-d189a08dfc42-kube-api-access-dq4r7\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:51.795689 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.795612    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-bound-sa-token\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:51.807702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.807666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:51.886008 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.885973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:51.886144 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.886090    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:51.886198 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.886186    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs podName:b1b32e1f-fea6-4c4f-b388-80205d64861b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:23.886172313 +0000 UTC m=+66.198397658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs") pod "network-metrics-daemon-7rggl" (UID: "b1b32e1f-fea6-4c4f-b388-80205d64861b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:17:51.920531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.920498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z2lpr"
Sep 11 21:17:51.986609 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:51.986580    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:51.986723 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.986708    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:17:51.986723 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.986722    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:17:51.986841 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.986731    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fvszr for pod openshift-network-diagnostics/network-check-target-n9v9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:51.986841 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:51.986778    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr podName:9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf nodeName:}" failed. No retries permitted until 2026-09-11 21:18:23.986766889 +0000 UTC m=+66.298992233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fvszr" (UniqueName: "kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr") pod "network-check-target-n9v9k" (UID: "9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:17:52.137327 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.137153    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:17:52.141704 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.141680    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:17:52.288627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.288589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:52.288774 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.288673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:52.288774 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:52.288740    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:17:52.288774 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:52.288758    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844bf8659c-w2s47: secret "image-registry-tls" not found
Sep 11 21:17:52.288889 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:52.288786    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:52.288889 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:52.288817    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls podName:6e14b95a-2f45-4180-9237-540c64a8da0d nodeName:}" failed. No retries permitted until 2026-09-11 21:17:53.288800022 +0000 UTC m=+35.601025389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls") pod "image-registry-844bf8659c-w2s47" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d") : secret "image-registry-tls" not found
Sep 11 21:17:52.288889 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:52.288843    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls podName:866539c7-de3c-4623-a54c-d189a08dfc42 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:53.288829913 +0000 UTC m=+35.601055257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls") pod "dns-default-j94n7" (UID: "866539c7-de3c-4623-a54c-d189a08dfc42") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:52.293001 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.292977    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed524755-5ece-4155-bc7f-d20e3be5c449" containerID="ff25e090f4082aa702c321689cf8e4945f6fb45f7d192e254220aa263d9fb12e" exitCode=0
Sep 11 21:17:52.293128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.293021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerDied","Data":"ff25e090f4082aa702c321689cf8e4945f6fb45f7d192e254220aa263d9fb12e"}
Sep 11 21:17:52.294798 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:52.294722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z2lpr"]
Sep 11 21:17:52.299206 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:17:52.299184    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde79141_414e_4126_b217_fcbb5dd41abf.slice/crio-cdff5fdf1a4777e622e1d0d60745cc1d4dd8d1952c016109001969562e2d4564 WatchSource:0}: Error finding container cdff5fdf1a4777e622e1d0d60745cc1d4dd8d1952c016109001969562e2d4564: Status 404 returned error can't find the container with id cdff5fdf1a4777e622e1d0d60745cc1d4dd8d1952c016109001969562e2d4564
Sep 11 21:17:53.014751 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.014716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:53.137429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.137394    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:17:53.137604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.137394    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:17:53.140329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.140305    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:17:53.140473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.140387    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:17:53.141486 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.141465    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:17:53.141486 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.141464    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vp72k\""
Sep 11 21:17:53.141653 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.141530    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqqz8\""
Sep 11 21:17:53.297223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.297144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:53.297930 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:53.297314    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:53.297930 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.297343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:53.297930 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:53.297379    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls podName:866539c7-de3c-4623-a54c-d189a08dfc42 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:55.297358147 +0000 UTC m=+37.609583497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls") pod "dns-default-j94n7" (UID: "866539c7-de3c-4623-a54c-d189a08dfc42") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:53.297930 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:53.297437    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:17:53.297930 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:53.297451    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844bf8659c-w2s47: secret "image-registry-tls" not found
Sep 11 21:17:53.297930 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:53.297496    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls podName:6e14b95a-2f45-4180-9237-540c64a8da0d nodeName:}" failed. No retries permitted until 2026-09-11 21:17:55.297479728 +0000 UTC m=+37.609705079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls") pod "image-registry-844bf8659c-w2s47" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d") : secret "image-registry-tls" not found
Sep 11 21:17:53.299678 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.299653    2572 generic.go:356] "Generic (PLEG): container finished" podID="ed524755-5ece-4155-bc7f-d20e3be5c449" containerID="584d33b16d79b1032b32aea0458db5da183994745e6e3e9f390ef6187c088e8e" exitCode=0
Sep 11 21:17:53.299786 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.299742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerDied","Data":"584d33b16d79b1032b32aea0458db5da183994745e6e3e9f390ef6187c088e8e"}
Sep 11 21:17:53.301307 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:53.301242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z2lpr" event={"ID":"fde79141-414e-4126-b217-fcbb5dd41abf","Type":"ContainerStarted","Data":"cdff5fdf1a4777e622e1d0d60745cc1d4dd8d1952c016109001969562e2d4564"}
Sep 11 21:17:54.308130 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:54.308093    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25sqt" event={"ID":"ed524755-5ece-4155-bc7f-d20e3be5c449","Type":"ContainerStarted","Data":"1945a3819a28852c3e7e12fbf9fe55c5646a54b355e749d5e5ed59758773b393"}
Sep 11 21:17:54.459497 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:54.459461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:54.545427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:54.545394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:54.633939 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:54.633832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:54.719295 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:54.719237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:54.782888 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:54.782853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:55.314539 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:55.314507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:55.314991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:55.314564    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:55.314991 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:55.314640    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:55.314991 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:55.314646    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:17:55.314991 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:55.314660    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844bf8659c-w2s47: secret "image-registry-tls" not found
Sep 11 21:17:55.314991 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:55.314682    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls podName:866539c7-de3c-4623-a54c-d189a08dfc42 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:59.314669113 +0000 UTC m=+41.626894458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls") pod "dns-default-j94n7" (UID: "866539c7-de3c-4623-a54c-d189a08dfc42") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:55.314991 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:55.314706    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls podName:6e14b95a-2f45-4180-9237-540c64a8da0d nodeName:}" failed. No retries permitted until 2026-09-11 21:17:59.314687558 +0000 UTC m=+41.626912917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls") pod "image-registry-844bf8659c-w2s47" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d") : secret "image-registry-tls" not found
Sep 11 21:17:55.660148 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:55.660107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:55.828331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:55.828297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:55.928993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:55.928886    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:56.314506 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:56.314472    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z2lpr" event={"ID":"fde79141-414e-4126-b217-fcbb5dd41abf","Type":"ContainerStarted","Data":"b610a00b0a5afa870131a41dbcc67adb0c6a66e3574bca5fbb53fa79f454d5a6"}
Sep 11 21:17:56.332200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:56.332151    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z2lpr" podStartSLOduration=2.22777105 podStartE2EDuration="5.332135124s" totalImagesPullingTime="3.104364074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:56.331004231 +0000 UTC m=+38.643229597" watchObservedRunningTime="2026-09-11 21:17:56.332135124 +0000 UTC m=+38.644360491"
Sep 11 21:17:56.332562 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:56.332444    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-25sqt" podStartSLOduration=9.385738827 podStartE2EDuration="38.332436395s" totalImagesPullingTime="28.946697568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:54.333557601 +0000 UTC m=+36.645782969" watchObservedRunningTime="2026-09-11 21:17:56.332436395 +0000 UTC m=+38.644661762"
Sep 11 21:17:56.518086 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:56.518048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:56.618432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:56.618334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:57.753742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:57.753706    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:57.806928 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:57.806884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:58.600773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:58.600736    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:59.143882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.143850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:59.204865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.204827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:59.344745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.344712    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:17:59.344945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.344765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:17:59.344945 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.344866    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:17:59.344945 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.344871    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:17:59.345098 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.344946    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls podName:866539c7-de3c-4623-a54c-d189a08dfc42 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.344927637 +0000 UTC m=+49.657152995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls") pod "dns-default-j94n7" (UID: "866539c7-de3c-4623-a54c-d189a08dfc42") : secret "dns-default-metrics-tls" not found
Sep 11 21:17:59.345098 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.344876    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844bf8659c-w2s47: secret "image-registry-tls" not found
Sep 11 21:17:59.345098 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.345004    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls podName:6e14b95a-2f45-4180-9237-540c64a8da0d nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.34499168 +0000 UTC m=+49.657217024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls") pod "image-registry-844bf8659c-w2s47" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d") : secret "image-registry-tls" not found
Sep 11 21:17:59.725771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.725738    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"]
Sep 11 21:17:59.752508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.752479    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"]
Sep 11 21:17:59.752670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.752615    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.755975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.755955    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.756106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.756057    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.756106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.756069    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 21:17:59.756198 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.756069    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 21:17:59.756198 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.756058    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4ccbc\""
Sep 11 21:17:59.772535 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.772509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"]
Sep 11 21:17:59.772627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.772554    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"]
Sep 11 21:17:59.772627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.772611    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:17:59.775111 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.775089    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 21:17:59.775212 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.775114    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.775212 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.775141    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.775212 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.775146    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xhwp4\""
Sep 11 21:17:59.808940 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.808910    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-kvb4l"]
Sep 11 21:17:59.830670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.830645    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-kvb4l"]
Sep 11 21:17:59.830799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.830733    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:17:59.833406 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.833388    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 21:17:59.833706 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.833687    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:17:59.833855 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.833829    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xmr9q\""
Sep 11 21:17:59.833949 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.833755    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 21:17:59.834000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.833964    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 21:17:59.840572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.840555    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 21:17:59.847710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.847693    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.847763 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.847719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rps\" (UniqueName: \"kubernetes.io/projected/2db02206-bf00-4167-a9af-08537e0bc750-kube-api-access-f8rps\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:17:59.847794 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.847773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5p2\" (UniqueName: \"kubernetes.io/projected/43e312cc-1d7f-4b91-a55f-789d40439b8b-kube-api-access-9l5p2\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.847836 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.847817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43e312cc-1d7f-4b91-a55f-789d40439b8b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.847867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.847839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:17:59.949146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-config\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:17:59.949146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.949394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rps\" (UniqueName: \"kubernetes.io/projected/2db02206-bf00-4167-a9af-08537e0bc750-kube-api-access-f8rps\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:17:59.949394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnqf\" (UniqueName: \"kubernetes.io/projected/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-kube-api-access-cfnqf\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:17:59.949394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-trusted-ca\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:17:59.949394 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.949318    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:17:59.949394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-serving-cert\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:17:59.949394 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.949388    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls podName:43e312cc-1d7f-4b91-a55f-789d40439b8b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:00.449373947 +0000 UTC m=+42.761599292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vrdhh" (UID: "43e312cc-1d7f-4b91-a55f-789d40439b8b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:17:59.949650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5p2\" (UniqueName: \"kubernetes.io/projected/43e312cc-1d7f-4b91-a55f-789d40439b8b-kube-api-access-9l5p2\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.949650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949470    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43e312cc-1d7f-4b91-a55f-789d40439b8b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.949650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.949493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:17:59.949650 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.949629    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:17:59.949791 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:17:59.949686    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls podName:2db02206-bf00-4167-a9af-08537e0bc750 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:00.449667889 +0000 UTC m=+42.761893252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4g4qf" (UID: "2db02206-bf00-4167-a9af-08537e0bc750") : secret "samples-operator-tls" not found
Sep 11 21:17:59.950037 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.950017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43e312cc-1d7f-4b91-a55f-789d40439b8b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.963063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.963031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5p2\" (UniqueName: \"kubernetes.io/projected/43e312cc-1d7f-4b91-a55f-789d40439b8b-kube-api-access-9l5p2\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:17:59.963063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.963044    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rps\" (UniqueName: \"kubernetes.io/projected/2db02206-bf00-4167-a9af-08537e0bc750-kube-api-access-f8rps\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:17:59.980300 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:17:59.980222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:00.050759 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.050720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-config\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.050934 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.050766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnqf\" (UniqueName: \"kubernetes.io/projected/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-kube-api-access-cfnqf\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.050934 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.050784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-trusted-ca\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.050934 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.050824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-serving-cert\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.051524 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.051498    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-config\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.052078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.052057    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-trusted-ca\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.052927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.052896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:00.053418 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.053398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-serving-cert\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.059734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.059715    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnqf\" (UniqueName: \"kubernetes.io/projected/44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7-kube-api-access-cfnqf\") pod \"console-operator-696884fb9c-kvb4l\" (UID: \"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7\") " pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.152932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.152900    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:00.454440 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.454405    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:00.454620 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.454578    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:00.454620 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:00.454579    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:00.454729 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:00.454654    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls podName:43e312cc-1d7f-4b91-a55f-789d40439b8b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:01.454631235 +0000 UTC m=+43.766856580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vrdhh" (UID: "43e312cc-1d7f-4b91-a55f-789d40439b8b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:00.454729 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:00.454661    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:18:00.454729 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:00.454701    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls podName:2db02206-bf00-4167-a9af-08537e0bc750 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:01.454689665 +0000 UTC m=+43.766915010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4g4qf" (UID: "2db02206-bf00-4167-a9af-08537e0bc750") : secret "samples-operator-tls" not found
Sep 11 21:18:00.457664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:00.457637    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-kvb4l"]
Sep 11 21:18:00.460693 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:00.460672    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ec3e0b_ad2d_4cb5_8c6b_0269bf3a34e7.slice/crio-3f1bf7566c138090046529ece42dfa681ba6a0662145b54591ddb17964440a9e WatchSource:0}: Error finding container 3f1bf7566c138090046529ece42dfa681ba6a0662145b54591ddb17964440a9e: Status 404 returned error can't find the container with id 3f1bf7566c138090046529ece42dfa681ba6a0662145b54591ddb17964440a9e
Sep 11 21:18:01.278546 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:01.278506    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:01.326364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:01.326319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" event={"ID":"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7","Type":"ContainerStarted","Data":"3f1bf7566c138090046529ece42dfa681ba6a0662145b54591ddb17964440a9e"}
Sep 11 21:18:01.375261 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:01.375226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:01.462585 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:01.462553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:01.462765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:01.462653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:01.462765 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:01.462741    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:01.462859 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:01.462822    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls podName:43e312cc-1d7f-4b91-a55f-789d40439b8b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:03.462800363 +0000 UTC m=+45.775025721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vrdhh" (UID: "43e312cc-1d7f-4b91-a55f-789d40439b8b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:01.462859 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:01.462749    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:18:01.462935 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:01.462897    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls podName:2db02206-bf00-4167-a9af-08537e0bc750 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:03.462884284 +0000 UTC m=+45.775109628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4g4qf" (UID: "2db02206-bf00-4167-a9af-08537e0bc750") : secret "samples-operator-tls" not found
Sep 11 21:18:02.721216 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:02.721173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:03.478176 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:03.478092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:03.478247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:03.478176    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:03.478312 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:03.478274    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:18:03.478370 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:03.478309    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:03.478370 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:03.478346    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls podName:2db02206-bf00-4167-a9af-08537e0bc750 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.478326327 +0000 UTC m=+49.790551691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4g4qf" (UID: "2db02206-bf00-4167-a9af-08537e0bc750") : secret "samples-operator-tls" not found
Sep 11 21:18:03.478448 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:03.478389    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls podName:43e312cc-1d7f-4b91-a55f-789d40439b8b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.478372509 +0000 UTC m=+49.790597860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vrdhh" (UID: "43e312cc-1d7f-4b91-a55f-789d40439b8b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:04.335524 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:04.335493    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/0.log"
Sep 11 21:18:04.335887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:04.335534    2572 generic.go:356] "Generic (PLEG): container finished" podID="44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7" containerID="ffd094420a36640a3979d60cca2113a5f774c03198f924fe886058cd6d36739b" exitCode=255
Sep 11 21:18:04.335887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:04.335562    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" event={"ID":"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7","Type":"ContainerDied","Data":"ffd094420a36640a3979d60cca2113a5f774c03198f924fe886058cd6d36739b"}
Sep 11 21:18:04.335887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:04.335787    2572 scope.go:117] "RemoveContainer" containerID="ffd094420a36640a3979d60cca2113a5f774c03198f924fe886058cd6d36739b"
Sep 11 21:18:05.339102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.339072    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:18:05.339516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.339490    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/0.log"
Sep 11 21:18:05.339567 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.339522    2572 generic.go:356] "Generic (PLEG): container finished" podID="44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7" containerID="0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1" exitCode=255
Sep 11 21:18:05.339618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.339567    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" event={"ID":"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7","Type":"ContainerDied","Data":"0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1"}
Sep 11 21:18:05.339618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.339611    2572 scope.go:117] "RemoveContainer" containerID="ffd094420a36640a3979d60cca2113a5f774c03198f924fe886058cd6d36739b"
Sep 11 21:18:05.339839 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.339822    2572 scope.go:117] "RemoveContainer" containerID="0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1"
Sep 11 21:18:05.340011 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:05.339992    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kvb4l_openshift-console-operator(44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7)\"" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" podUID="44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7"
Sep 11 21:18:05.953011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.952978    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t29x7"]
Sep 11 21:18:05.971453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.971423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:05.986036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.986003    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t29x7"]
Sep 11 21:18:05.986146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.986127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:05.988594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.988568    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 21:18:05.988695 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.988594    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 21:18:05.988695 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.988616    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 21:18:05.989004 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.988975    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qrmzx\""
Sep 11 21:18:05.992667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:05.992648    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 21:18:06.031715 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.031684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:06.096316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.096281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6d956d1-2630-4f73-ae39-083777ff7b67-crio-socket\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.096316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.096316    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6d956d1-2630-4f73-ae39-083777ff7b67-data-volume\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.096508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.096346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.096508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.096419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.096508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.096483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfh6g\" (UniqueName: \"kubernetes.io/projected/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-api-access-dfh6g\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.196859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.196813    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6d956d1-2630-4f73-ae39-083777ff7b67-crio-socket\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.196859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.196865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6d956d1-2630-4f73-ae39-083777ff7b67-data-volume\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.197066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.196902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.197066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.196927    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.197066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.196990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfh6g\" (UniqueName: \"kubernetes.io/projected/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-api-access-dfh6g\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.197066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.197030    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6d956d1-2630-4f73-ae39-083777ff7b67-crio-socket\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.197066 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.197058    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.197294 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.197069    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.197294 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.197148    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:06.697128076 +0000 UTC m=+49.009353436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.197294 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.197168    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:06.697158458 +0000 UTC m=+49.009383805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.197294 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.197226    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6d956d1-2630-4f73-ae39-083777ff7b67-data-volume\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.205855 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.205799    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfh6g\" (UniqueName: \"kubernetes.io/projected/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-api-access-dfh6g\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.333691 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.333655    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"]
Sep 11 21:18:06.343012 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.342987    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:18:06.343426 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.343305    2572 scope.go:117] "RemoveContainer" containerID="0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1"
Sep 11 21:18:06.343473 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.343449    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kvb4l_openshift-console-operator(44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7)\"" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" podUID="44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7"
Sep 11 21:18:06.354287 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.354222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:06.354542 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.354521    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"]
Sep 11 21:18:06.354627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.354605    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"
Sep 11 21:18:06.356759 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.356739    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wf9nm\""
Sep 11 21:18:06.356859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.356788    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 21:18:06.357039 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.357023    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 21:18:06.447613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.447581    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:06.498795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.498765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mbct\" (UniqueName: \"kubernetes.io/projected/e3a09666-6181-4f47-8540-08ec6f876691-kube-api-access-6mbct\") pod \"migrator-8b4d697c5-n2gzv\" (UID: \"e3a09666-6181-4f47-8540-08ec6f876691\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"
Sep 11 21:18:06.600167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.600130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mbct\" (UniqueName: \"kubernetes.io/projected/e3a09666-6181-4f47-8540-08ec6f876691-kube-api-access-6mbct\") pod \"migrator-8b4d697c5-n2gzv\" (UID: \"e3a09666-6181-4f47-8540-08ec6f876691\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"
Sep 11 21:18:06.609116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.609090    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mbct\" (UniqueName: \"kubernetes.io/projected/e3a09666-6181-4f47-8540-08ec6f876691-kube-api-access-6mbct\") pod \"migrator-8b4d697c5-n2gzv\" (UID: \"e3a09666-6181-4f47-8540-08ec6f876691\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"
Sep 11 21:18:06.663104 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.663066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"
Sep 11 21:18:06.701609 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.701579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.701747 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.701731    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.701802 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.701783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:06.701802 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.701792    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.701776863 +0000 UTC m=+50.014002206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:06.701917 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.701901    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.701989 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:06.701977    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:07.701959193 +0000 UTC m=+50.014184554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : configmap "kube-rbac-proxy" not found
Sep 11 21:18:06.734813 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.734787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:06.837247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.837156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:06.954577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:06.954547    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv"]
Sep 11 21:18:06.957801 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:06.957766    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a09666_6181_4f47_8540_08ec6f876691.slice/crio-38f1669a3995f260c8c06b43f576f849e1cea90592908ec08cb00629373e9440 WatchSource:0}: Error finding container 38f1669a3995f260c8c06b43f576f849e1cea90592908ec08cb00629373e9440: Status 404 returned error can't find the container with id 38f1669a3995f260c8c06b43f576f849e1cea90592908ec08cb00629373e9440
Sep 11 21:18:07.010344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.010300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:07.113733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.113641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:07.346510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.346477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv" event={"ID":"e3a09666-6181-4f47-8540-08ec6f876691","Type":"ContainerStarted","Data":"38f1669a3995f260c8c06b43f576f849e1cea90592908ec08cb00629373e9440"}
Sep 11 21:18:07.368525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.368451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:07.407785 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.407763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:18:07.407918 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.407798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:18:07.407918 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.407910    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:18:07.407987 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.407921    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844bf8659c-w2s47: secret "image-registry-tls" not found
Sep 11 21:18:07.407987 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.407961    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls podName:6e14b95a-2f45-4180-9237-540c64a8da0d nodeName:}" failed. No retries permitted until 2026-09-11 21:18:23.407948421 +0000 UTC m=+65.720173766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls") pod "image-registry-844bf8659c-w2s47" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d") : secret "image-registry-tls" not found
Sep 11 21:18:07.408057 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.408013    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:18:07.408089 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.408078    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls podName:866539c7-de3c-4623-a54c-d189a08dfc42 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:23.408062223 +0000 UTC m=+65.720287567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls") pod "dns-default-j94n7" (UID: "866539c7-de3c-4623-a54c-d189a08dfc42") : secret "dns-default-metrics-tls" not found
Sep 11 21:18:07.508239 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.508203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:07.508423 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.508369    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:18:07.508462 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.508430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:07.508462 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.508445    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls podName:2db02206-bf00-4167-a9af-08537e0bc750 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:15.508427755 +0000 UTC m=+57.820653113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4g4qf" (UID: "2db02206-bf00-4167-a9af-08537e0bc750") : secret "samples-operator-tls" not found
Sep 11 21:18:07.508535 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.508500    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:07.508567 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.508537    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls podName:43e312cc-1d7f-4b91-a55f-789d40439b8b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:15.508529197 +0000 UTC m=+57.820754545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vrdhh" (UID: "43e312cc-1d7f-4b91-a55f-789d40439b8b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:07.523324 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.523286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:07.639372 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.639281    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:07.710380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.710343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:07.710551 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.710464    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:07.710551 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.710516    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:07.710645 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.710563    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:18:07.710645 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.710592    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:09.710571236 +0000 UTC m=+52.022796582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:07.710645 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:07.710617    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:09.710600925 +0000 UTC m=+52.022826275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : configmap "kube-rbac-proxy" not found
Sep 11 21:18:07.736693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.736581    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5wkq_78f27213-1912-4b33-a88b-dda868cf6097/dns-node-resolver/0.log"
Sep 11 21:18:07.927575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:07.927493    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:08.140489 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:08.140463    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97mgb_30685afa-38a1-4e1d-b6e9-74d2328f180e/node-ca/0.log"
Sep 11 21:18:08.661816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:08.661780    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:08.727812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:08.727723    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:09.138013 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.137979    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z2lpr_fde79141-414e-4126-b217-fcbb5dd41abf/serve-healthcheck-canary/0.log"
Sep 11 21:18:09.353140 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.353104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv" event={"ID":"e3a09666-6181-4f47-8540-08ec6f876691","Type":"ContainerStarted","Data":"ce4d0e2ac09fec74d745361d2e300568dc3ce44d26d64ecb742e688303b06d7a"}
Sep 11 21:18:09.353334 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.353186    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv" event={"ID":"e3a09666-6181-4f47-8540-08ec6f876691","Type":"ContainerStarted","Data":"8da40e82527509b51a8f2b161c57a18675346030d8a1b151c1e696ef0dfe6c89"}
Sep 11 21:18:09.371001 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.370955    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-n2gzv" podStartSLOduration=1.853008073 podStartE2EDuration="3.370939935s" totalImagesPullingTime="1.517931862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:09.369547703 +0000 UTC m=+51.681773070" watchObservedRunningTime="2026-09-11 21:18:09.370939935 +0000 UTC m=+51.683165359"
Sep 11 21:18:09.727272 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.727199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:09.727712 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.727335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:09.727712 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:09.727365    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:09.727712 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:09.727440    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:13.727420639 +0000 UTC m=+56.039646025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:09.727929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.727907    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6d956d1-2630-4f73-ae39-083777ff7b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:09.754891 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:09.754853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:10.153912 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:10.153871    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:10.154109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:10.153927    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:10.154347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:10.154329    2572 scope.go:117] "RemoveContainer" containerID="0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1"
Sep 11 21:18:10.154545 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:10.154504    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kvb4l_openshift-console-operator(44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7)\"" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" podUID="44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7"
Sep 11 21:18:10.356041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:10.356010    2572 scope.go:117] "RemoveContainer" containerID="0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1"
Sep 11 21:18:10.356177 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:10.356152    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-kvb4l_openshift-console-operator(44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7)\"" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" podUID="44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7"
Sep 11 21:18:11.535547 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:11.535508    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:11.638205 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:11.638161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:13.520795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:13.520759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:13.637511 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:13.637472    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:13.759263 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:13.759209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:13.759426 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:13.759371    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:13.759495 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:13.759476    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls podName:b6d956d1-2630-4f73-ae39-083777ff7b67 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:21.759455902 +0000 UTC m=+64.071681251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t29x7" (UID: "b6d956d1-2630-4f73-ae39-083777ff7b67") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:18:13.843562 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:13.843469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:14.004650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:14.004614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:14.186286 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:14.186183    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:14.325449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:14.325411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:14.995828 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:14.995793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:15.346014 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.345971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:15.555677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.555636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:15.572677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.572645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:15.572792 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.572707    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:15.572834 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:15.572807    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:15.572893 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:15.572882    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls podName:43e312cc-1d7f-4b91-a55f-789d40439b8b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:31.572861675 +0000 UTC m=+73.885087021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-vrdhh" (UID: "43e312cc-1d7f-4b91-a55f-789d40439b8b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:18:15.575072 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.575052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2db02206-bf00-4167-a9af-08537e0bc750-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4g4qf\" (UID: \"2db02206-bf00-4167-a9af-08537e0bc750\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:15.680469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.680390    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"
Sep 11 21:18:15.780111 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.780070    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:15.999455 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:15.999426    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf"]
Sep 11 21:18:16.013374 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:16.013339    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:16.279116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:16.279048    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tn94q"
Sep 11 21:18:16.360240 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:16.360207    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:16.369825 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:16.369793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf" event={"ID":"2db02206-bf00-4167-a9af-08537e0bc750","Type":"ContainerStarted","Data":"430065d9756e9300b8122bdb6efee8070dd66c55438924efa8fb7af064184833"}
Sep 11 21:18:17.020451 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:17.020408    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:17.356683 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:17.356603    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:17.570005 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:17.569967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:17.713080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:17.712995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:17.850432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:17.850403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:18.055185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:18.055145    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:18.150340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:18.150304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:18.253357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:18.253320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:18.377207 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:18.377120    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf" event={"ID":"2db02206-bf00-4167-a9af-08537e0bc750","Type":"ContainerStarted","Data":"bf43523782f37deb70002b521ee1e9674e7c0eae3ad85ecf92f7934b98f6a021"}
Sep 11 21:18:18.377207 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:18.377173    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf" event={"ID":"2db02206-bf00-4167-a9af-08537e0bc750","Type":"ContainerStarted","Data":"4c1d5b417fde58398ec4d04e6acf3abb181de9f077d531cf887fb4ab4c650a68"}
Sep 11 21:18:19.419214 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:19.419181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:19.608673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:19.608637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:19.748018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:19.747983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:19.987159 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:19.987127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:20.139588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:20.139504    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:20.245267 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:20.245222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.137339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.137309    2572 scope.go:117] "RemoveContainer" containerID="0cf3e2c4fbdd06578f93b8978647981ab0718e862966e29f930af5034b0220b1"
Sep 11 21:18:21.194770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.194744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.389231 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.389144    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:18:21.389231 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.389206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" event={"ID":"44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7","Type":"ContainerStarted","Data":"84fd55c9f633523e87e57744db5eddae31aa1eeea7c777dd05a6e600a035bfeb"}
Sep 11 21:18:21.389505 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.389488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:21.419086 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.419036    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l" podStartSLOduration=19.507687156 podStartE2EDuration="22.419020643s" totalImagesPullingTime="2.911333487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:21.418778787 +0000 UTC m=+63.731004153" watchObservedRunningTime="2026-09-11 21:18:21.419020643 +0000 UTC m=+63.731246009"
Sep 11 21:18:21.419362 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.419340    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4g4qf" podStartSLOduration=20.714419083 podStartE2EDuration="22.41933183s" totalImagesPullingTime="1.704912747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:18.416565069 +0000 UTC m=+60.728790434" watchObservedRunningTime="2026-09-11 21:18:21.41933183 +0000 UTC m=+63.731557195"
Sep 11 21:18:21.525581 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.525548    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-kvb4l"
Sep 11 21:18:21.624106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.624064    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.824287 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.824234    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:21.825895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.825863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.826830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.826812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6d956d1-2630-4f73-ae39-083777ff7b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t29x7\" (UID: \"b6d956d1-2630-4f73-ae39-083777ff7b67\") " pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:21.902603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.902575    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qrmzx\""
Sep 11 21:18:21.908464 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:21.908445    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t29x7"
Sep 11 21:18:22.030903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.030870    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.215527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.215433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.215527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.215520    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t29x7"]
Sep 11 21:18:22.218958 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:22.218936    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d956d1_2630_4f73_ae39_083777ff7b67.slice/crio-5a991542ba354cd7b1471c714a53b9dd3af437f84fc14f912dd1614179496ac8 WatchSource:0}: Error finding container 5a991542ba354cd7b1471c714a53b9dd3af437f84fc14f912dd1614179496ac8: Status 404 returned error can't find the container with id 5a991542ba354cd7b1471c714a53b9dd3af437f84fc14f912dd1614179496ac8
Sep 11 21:18:22.318010 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.317981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.393565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.393523    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t29x7" event={"ID":"b6d956d1-2630-4f73-ae39-083777ff7b67","Type":"ContainerStarted","Data":"8a7b5c72c65e353a2044ad93c7f124c4d1fc3774daa4fb83475a9ca9b9831439"}
Sep 11 21:18:22.393719 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.393586    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t29x7" event={"ID":"b6d956d1-2630-4f73-ae39-083777ff7b67","Type":"ContainerStarted","Data":"5a991542ba354cd7b1471c714a53b9dd3af437f84fc14f912dd1614179496ac8"}
Sep 11 21:18:22.419961 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.419930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.520556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.520520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.636616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:22.636588    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.015527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.015491    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.253449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.253413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.355078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.354989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.398616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.398587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t29x7" event={"ID":"b6d956d1-2630-4f73-ae39-083777ff7b67","Type":"ContainerStarted","Data":"57f9422a0b05f3d623d978ab6c016389a75c51d2d8d2847a2040ea355bf533f9"}
Sep 11 21:18:23.438431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.438396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:18:23.438603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.438461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:18:23.444368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.441056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"image-registry-844bf8659c-w2s47\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") " pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:18:23.444368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.440743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/866539c7-de3c-4623-a54c-d189a08dfc42-metrics-tls\") pod \"dns-default-j94n7\" (UID: \"866539c7-de3c-4623-a54c-d189a08dfc42\") " pod="openshift-dns/dns-default-j94n7"
Sep 11 21:18:23.546525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.546483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.655794 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.655710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.689744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.689704    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xvbfg\""
Sep 11 21:18:23.695168 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.695131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:18:23.714473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.714450    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdgmr\""
Sep 11 21:18:23.722311 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.722276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j94n7"
Sep 11 21:18:23.768310 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.768273    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.842478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.842446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:18:23.845478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.845454    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:18:23.856142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.856111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cf12b1b-2278-4c3f-907d-2126b4406c47-original-pull-secret\") pod \"global-pull-secret-syncer-kml8k\" (UID: \"4cf12b1b-2278-4c3f-907d-2126b4406c47\") " pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:18:23.913523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.913410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.943676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.943632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:18:23.946342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.946314    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kml8k"
Sep 11 21:18:23.946637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.946607    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:18:23.957196 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:23.957171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1b32e1f-fea6-4c4f-b388-80205d64861b-metrics-certs\") pod \"network-metrics-daemon-7rggl\" (UID: \"b1b32e1f-fea6-4c4f-b388-80205d64861b\") " pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:18:24.016366 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.015926    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844bf8659c-w2s47"]
Sep 11 21:18:24.034801 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.034735    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j94n7"]
Sep 11 21:18:24.041297 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:24.041245    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866539c7_de3c_4623_a54c_d189a08dfc42.slice/crio-6d7001bc8abc7fc9e3fd0c19a4b7c6f43f8cf9719020b2b06819630af4e40aa0 WatchSource:0}: Error finding container 6d7001bc8abc7fc9e3fd0c19a4b7c6f43f8cf9719020b2b06819630af4e40aa0: Status 404 returned error can't find the container with id 6d7001bc8abc7fc9e3fd0c19a4b7c6f43f8cf9719020b2b06819630af4e40aa0
Sep 11 21:18:24.044143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.044115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:18:24.052115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.052097    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:18:24.053993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.053976    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqqz8\""
Sep 11 21:18:24.059626 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.059600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rggl"
Sep 11 21:18:24.059718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.059672    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:18:24.068401 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.068379    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvszr\" (UniqueName: \"kubernetes.io/projected/9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf-kube-api-access-fvszr\") pod \"network-check-target-n9v9k\" (UID: \"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf\") " pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:18:24.106799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.106752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:24.206977 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.206885    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:24.225806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.225729    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kml8k"]
Sep 11 21:18:24.352072 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.352040    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rggl"]
Sep 11 21:18:24.358020 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.357997    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vp72k\""
Sep 11 21:18:24.365360 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.365325    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:18:24.404729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.404622    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j94n7" event={"ID":"866539c7-de3c-4623-a54c-d189a08dfc42","Type":"ContainerStarted","Data":"6d7001bc8abc7fc9e3fd0c19a4b7c6f43f8cf9719020b2b06819630af4e40aa0"}
Sep 11 21:18:24.406498 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.406465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" event={"ID":"6e14b95a-2f45-4180-9237-540c64a8da0d","Type":"ContainerStarted","Data":"7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6"}
Sep 11 21:18:24.406628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.406517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" event={"ID":"6e14b95a-2f45-4180-9237-540c64a8da0d","Type":"ContainerStarted","Data":"82118d073b8da4c997e599785c56d1ceff9411a4de371398f9be8978188b025a"}
Sep 11 21:18:24.406628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.406555    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:18:24.444292 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.444216    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" podStartSLOduration=66.44419531 podStartE2EDuration="1m6.44419531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:24.443481157 +0000 UTC m=+66.755706523" watchObservedRunningTime="2026-09-11 21:18:24.44419531 +0000 UTC m=+66.756420744"
Sep 11 21:18:24.564456 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:24.564425    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b32e1f_fea6_4c4f_b388_80205d64861b.slice/crio-f397a030001cbafbbdaaada31f020a385bdfa82de161d9f6f9e1db897beae3de WatchSource:0}: Error finding container f397a030001cbafbbdaaada31f020a385bdfa82de161d9f6f9e1db897beae3de: Status 404 returned error can't find the container with id f397a030001cbafbbdaaada31f020a385bdfa82de161d9f6f9e1db897beae3de
Sep 11 21:18:24.565505 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:24.565367    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf12b1b_2278_4c3f_907d_2126b4406c47.slice/crio-702c7be48ef37baadf5f9d6005b3dec478b7af08fcef1592571001e3f96018ff WatchSource:0}: Error finding container 702c7be48ef37baadf5f9d6005b3dec478b7af08fcef1592571001e3f96018ff: Status 404 returned error can't find the container with id 702c7be48ef37baadf5f9d6005b3dec478b7af08fcef1592571001e3f96018ff
Sep 11 21:18:24.615523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.615425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:24.837746 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:24.837661    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9v9k"]
Sep 11 21:18:24.841394 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:24.841368    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df5e85c_d97f_462a_b0e1_53c5d2b8b1cf.slice/crio-81fd2a071d5cee186b061472b05e8d7a191113a172a476ed1688dc6f71761490 WatchSource:0}: Error finding container 81fd2a071d5cee186b061472b05e8d7a191113a172a476ed1688dc6f71761490: Status 404 returned error can't find the container with id 81fd2a071d5cee186b061472b05e8d7a191113a172a476ed1688dc6f71761490
Sep 11 21:18:25.414011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:25.413330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t29x7" event={"ID":"b6d956d1-2630-4f73-ae39-083777ff7b67","Type":"ContainerStarted","Data":"f9481424b5f5d79b4b50bae0e24a13b445a5abf4a2e0256f2c2f2ecd1beccb3b"}
Sep 11 21:18:25.415927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:25.415861    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kml8k" event={"ID":"4cf12b1b-2278-4c3f-907d-2126b4406c47","Type":"ContainerStarted","Data":"702c7be48ef37baadf5f9d6005b3dec478b7af08fcef1592571001e3f96018ff"}
Sep 11 21:18:25.417200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:25.417170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9v9k" event={"ID":"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf","Type":"ContainerStarted","Data":"81fd2a071d5cee186b061472b05e8d7a191113a172a476ed1688dc6f71761490"}
Sep 11 21:18:25.418795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:25.418770    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rggl" event={"ID":"b1b32e1f-fea6-4c4f-b388-80205d64861b","Type":"ContainerStarted","Data":"f397a030001cbafbbdaaada31f020a385bdfa82de161d9f6f9e1db897beae3de"}
Sep 11 21:18:25.437635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:25.437572    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t29x7" podStartSLOduration=18.219460832 podStartE2EDuration="20.437550161s" totalImagesPullingTime="2.218089329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:18:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:25.435857199 +0000 UTC m=+67.748082565" watchObservedRunningTime="2026-09-11 21:18:25.437550161 +0000 UTC m=+67.749775522"
Sep 11 21:18:26.425907 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:26.425759    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rggl" event={"ID":"b1b32e1f-fea6-4c4f-b388-80205d64861b","Type":"ContainerStarted","Data":"cd473a51e870ec646956ccfc037a97ac138a8f14dd4cf8cc152c76c696133bfe"}
Sep 11 21:18:26.429162 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:26.429126    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j94n7" event={"ID":"866539c7-de3c-4623-a54c-d189a08dfc42","Type":"ContainerStarted","Data":"800090f4290a230930ac98bd6c4b123a9260fe9ba80164e1e1106177e3e6a463"}
Sep 11 21:18:27.436095 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:27.436051    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j94n7" event={"ID":"866539c7-de3c-4623-a54c-d189a08dfc42","Type":"ContainerStarted","Data":"d1a1157a5e40cb2e7f662c94b9699e7de7af0bb380662b854c419d478ad93c36"}
Sep 11 21:18:27.436598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:27.436150    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j94n7"
Sep 11 21:18:27.438372 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:27.438345    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rggl" event={"ID":"b1b32e1f-fea6-4c4f-b388-80205d64861b","Type":"ContainerStarted","Data":"b5860c603fc12033f8ba7f5ec52070fa5473a1c3e6ebadb36186bcc33960cf3e"}
Sep 11 21:18:27.455806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:27.455749    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j94n7" podStartSLOduration=34.242128422 podStartE2EDuration="36.455732685s" totalImagesPullingTime="2.213604263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:27.4543936 +0000 UTC m=+69.766618966" watchObservedRunningTime="2026-09-11 21:18:27.455732685 +0000 UTC m=+69.767958051"
Sep 11 21:18:27.473558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:27.473489    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7rggl" podStartSLOduration=67.783233669 podStartE2EDuration="1m9.473470618s" totalImagesPullingTime="1.690236949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:27.472171287 +0000 UTC m=+69.784396654" watchObservedRunningTime="2026-09-11 21:18:27.473470618 +0000 UTC m=+69.785695983"
Sep 11 21:18:29.155709 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:29.155673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:29.259694 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:29.259659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:30.452579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:30.452536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kml8k" event={"ID":"4cf12b1b-2278-4c3f-907d-2126b4406c47","Type":"ContainerStarted","Data":"3bd4c3548e31b9f2d0794d5461ee219ce822a6d7449990845678cb61e37ea5cb"}
Sep 11 21:18:30.454139 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:30.454114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9v9k" event={"ID":"9df5e85c-d97f-462a-b0e1-53c5d2b8b1cf","Type":"ContainerStarted","Data":"ab7e95b30a2c739bac672dd06fe186764726c311c581dcd3dfeebc1a7dbafd31"}
Sep 11 21:18:30.454285 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:30.454227    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:18:30.471332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:30.471289    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kml8k" podStartSLOduration=67.382730999 podStartE2EDuration="1m12.471275577s" totalImagesPullingTime="5.088544578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:30.470534207 +0000 UTC m=+72.782759573" watchObservedRunningTime="2026-09-11 21:18:30.471275577 +0000 UTC m=+72.783500939"
Sep 11 21:18:30.496976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:30.496914    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n9v9k" podStartSLOduration=67.689409088 podStartE2EDuration="1m12.496892583s" totalImagesPullingTime="4.807483495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:30.496610873 +0000 UTC m=+72.808836238" watchObservedRunningTime="2026-09-11 21:18:30.496892583 +0000 UTC m=+72.809117949"
Sep 11 21:18:31.228699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.228660    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"]
Sep 11 21:18:31.231525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.231500    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-qztkg"]
Sep 11 21:18:31.231655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.231622    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.234085 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.234064    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 21:18:31.234466 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.234448    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 21:18:31.234592 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.234575    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:31.234817 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.234798    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cr2sz\""
Sep 11 21:18:31.241169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.241143    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 21:18:31.241320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.241150    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 21:18:31.241320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.241244    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vxk9z\""
Sep 11 21:18:31.250863 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.250837    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"]
Sep 11 21:18:31.257041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.257013    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qztkg"]
Sep 11 21:18:31.298164 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.298126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:31.313766 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.313732    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13b90bbb-e11d-42dd-98bd-22876c19a6d8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-nv6bd\" (UID: \"13b90bbb-e11d-42dd-98bd-22876c19a6d8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.313766 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.313769    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngs7j\" (UniqueName: \"kubernetes.io/projected/8c3a8259-ada8-4167-a187-c3875098b2e9-kube-api-access-ngs7j\") pod \"downloads-76f99584f4-qztkg\" (UID: \"8c3a8259-ada8-4167-a187-c3875098b2e9\") " pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:31.313973 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.313798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13b90bbb-e11d-42dd-98bd-22876c19a6d8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-nv6bd\" (UID: \"13b90bbb-e11d-42dd-98bd-22876c19a6d8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.414929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.414893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13b90bbb-e11d-42dd-98bd-22876c19a6d8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-nv6bd\" (UID: \"13b90bbb-e11d-42dd-98bd-22876c19a6d8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.415101 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.414935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngs7j\" (UniqueName: \"kubernetes.io/projected/8c3a8259-ada8-4167-a187-c3875098b2e9-kube-api-access-ngs7j\") pod \"downloads-76f99584f4-qztkg\" (UID: \"8c3a8259-ada8-4167-a187-c3875098b2e9\") " pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:31.415101 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.414973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13b90bbb-e11d-42dd-98bd-22876c19a6d8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-nv6bd\" (UID: \"13b90bbb-e11d-42dd-98bd-22876c19a6d8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.415657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.415633    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13b90bbb-e11d-42dd-98bd-22876c19a6d8-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-nv6bd\" (UID: \"13b90bbb-e11d-42dd-98bd-22876c19a6d8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.417422 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.417402    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13b90bbb-e11d-42dd-98bd-22876c19a6d8-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-nv6bd\" (UID: \"13b90bbb-e11d-42dd-98bd-22876c19a6d8\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.425584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.425550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngs7j\" (UniqueName: \"kubernetes.io/projected/8c3a8259-ada8-4167-a187-c3875098b2e9-kube-api-access-ngs7j\") pod \"downloads-76f99584f4-qztkg\" (UID: \"8c3a8259-ada8-4167-a187-c3875098b2e9\") " pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:31.513563 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.513517    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:31.541489 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.541453    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"
Sep 11 21:18:31.546727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.546705    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:31.616738 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.616701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:31.618961 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.618934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43e312cc-1d7f-4b91-a55f-789d40439b8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-vrdhh\" (UID: \"43e312cc-1d7f-4b91-a55f-789d40439b8b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:31.678989 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.678959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:31.821202 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.821087    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd"]
Sep 11 21:18:31.822495 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.822472    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qztkg"]
Sep 11 21:18:31.823494 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:31.823462    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3a8259_ada8_4167_a187_c3875098b2e9.slice/crio-58fb790d344fd98f0eea811bbb9b3c61d718b012854e1f62413f0f6889b472e7 WatchSource:0}: Error finding container 58fb790d344fd98f0eea811bbb9b3c61d718b012854e1f62413f0f6889b472e7: Status 404 returned error can't find the container with id 58fb790d344fd98f0eea811bbb9b3c61d718b012854e1f62413f0f6889b472e7
Sep 11 21:18:31.823893 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:31.823875    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b90bbb_e11d_42dd_98bd_22876c19a6d8.slice/crio-1db1d72858c0edcde52bf1eb2999888540fea24e368fb202c3544631890e6f9d WatchSource:0}: Error finding container 1db1d72858c0edcde52bf1eb2999888540fea24e368fb202c3544631890e6f9d: Status 404 returned error can't find the container with id 1db1d72858c0edcde52bf1eb2999888540fea24e368fb202c3544631890e6f9d
Sep 11 21:18:31.864365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.864327    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4ccbc\""
Sep 11 21:18:31.872370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:31.872331    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"
Sep 11 21:18:32.146233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.146209    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh"]
Sep 11 21:18:32.148139 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:32.148113    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e312cc_1d7f_4b91_a55f_789d40439b8b.slice/crio-b667d7444e15782b5a5387b92f1c9e01fb093094dbf81be4971de8f92c7eec59 WatchSource:0}: Error finding container b667d7444e15782b5a5387b92f1c9e01fb093094dbf81be4971de8f92c7eec59: Status 404 returned error can't find the container with id b667d7444e15782b5a5387b92f1c9e01fb093094dbf81be4971de8f92c7eec59
Sep 11 21:18:32.462963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.462831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qztkg" event={"ID":"8c3a8259-ada8-4167-a187-c3875098b2e9","Type":"ContainerStarted","Data":"58fb790d344fd98f0eea811bbb9b3c61d718b012854e1f62413f0f6889b472e7"}
Sep 11 21:18:32.464318 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.464285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd" event={"ID":"13b90bbb-e11d-42dd-98bd-22876c19a6d8","Type":"ContainerStarted","Data":"1db1d72858c0edcde52bf1eb2999888540fea24e368fb202c3544631890e6f9d"}
Sep 11 21:18:32.465880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.465855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh" event={"ID":"43e312cc-1d7f-4b91-a55f-789d40439b8b","Type":"ContainerStarted","Data":"b667d7444e15782b5a5387b92f1c9e01fb093094dbf81be4971de8f92c7eec59"}
Sep 11 21:18:32.714101 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.714012    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:32.813729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.813644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:32.913462 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:32.913423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:33.442627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:33.442463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:33.472080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:33.472040    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd" event={"ID":"13b90bbb-e11d-42dd-98bd-22876c19a6d8","Type":"ContainerStarted","Data":"dbdba7e908733d7de1352ccb1c6daeff308c3a87ee2f587284d63e902f216713"}
Sep 11 21:18:33.495313 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:33.495244    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nv6bd" podStartSLOduration=1.155105398 podStartE2EDuration="2.495225678s" totalImagesPullingTime="1.34012028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:33.493424597 +0000 UTC m=+75.805649999" watchObservedRunningTime="2026-09-11 21:18:33.495225678 +0000 UTC m=+75.807451083"
Sep 11 21:18:33.547498 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:33.547408    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:33.975073 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:33.975032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:34.386244 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.386204    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:34.477664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.477624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh" event={"ID":"43e312cc-1d7f-4b91-a55f-789d40439b8b","Type":"ContainerStarted","Data":"03097c5538bcda9e5a1f197d26df49d7cd251657283f407225950e63185d4960"}
Sep 11 21:18:34.484051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.484021    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:34.493864 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.493767    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-vrdhh" podStartSLOduration=33.582209461 podStartE2EDuration="35.493720788s" totalImagesPullingTime="1.911511327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:34.493302859 +0000 UTC m=+76.805528229" watchObservedRunningTime="2026-09-11 21:18:34.493720788 +0000 UTC m=+76.805946156"
Sep 11 21:18:34.588686 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.588647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:34.599390 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.599358    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"]
Sep 11 21:18:34.603827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.603804    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:34.606268 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.606232    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 21:18:34.606368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.606284    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rnbq4\""
Sep 11 21:18:34.611136 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.611091    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"]
Sep 11 21:18:34.643999 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.643912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a98bf6da-ef01-4637-a2d6-93c59421878b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-f2tgw\" (UID: \"a98bf6da-ef01-4637-a2d6-93c59421878b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:34.745291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:34.745246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a98bf6da-ef01-4637-a2d6-93c59421878b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-f2tgw\" (UID: \"a98bf6da-ef01-4637-a2d6-93c59421878b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:34.745532 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:34.745509    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 21:18:34.745653 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:34.745625    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98bf6da-ef01-4637-a2d6-93c59421878b-tls-certificates podName:a98bf6da-ef01-4637-a2d6-93c59421878b nodeName:}" failed. No retries permitted until 2026-09-11 21:18:35.245599558 +0000 UTC m=+77.557824909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a98bf6da-ef01-4637-a2d6-93c59421878b-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-f2tgw" (UID: "a98bf6da-ef01-4637-a2d6-93c59421878b") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 11 21:18:35.123812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:35.123764    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:35.249557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:35.249521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a98bf6da-ef01-4637-a2d6-93c59421878b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-f2tgw\" (UID: \"a98bf6da-ef01-4637-a2d6-93c59421878b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:35.252362 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:35.252335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a98bf6da-ef01-4637-a2d6-93c59421878b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-f2tgw\" (UID: \"a98bf6da-ef01-4637-a2d6-93c59421878b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:35.515169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:35.515126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:35.791729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:35.791682    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"]
Sep 11 21:18:35.794889 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:35.794854    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98bf6da_ef01_4637_a2d6_93c59421878b.slice/crio-b9ce324caf84850bd914ab79df2b52ff50f04c964bb518652fb0624f79bb2cbc WatchSource:0}: Error finding container b9ce324caf84850bd914ab79df2b52ff50f04c964bb518652fb0624f79bb2cbc: Status 404 returned error can't find the container with id b9ce324caf84850bd914ab79df2b52ff50f04c964bb518652fb0624f79bb2cbc
Sep 11 21:18:36.489734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:36.489694    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw" event={"ID":"a98bf6da-ef01-4637-a2d6-93c59421878b","Type":"ContainerStarted","Data":"b9ce324caf84850bd914ab79df2b52ff50f04c964bb518652fb0624f79bb2cbc"}
Sep 11 21:18:37.445058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.445027    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j94n7"
Sep 11 21:18:37.496741 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.496360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw" event={"ID":"a98bf6da-ef01-4637-a2d6-93c59421878b","Type":"ContainerStarted","Data":"22b154a1d0c66a2642b10319bbcfba212b6b0e04cf65fe78c74288bf28b3c5f3"}
Sep 11 21:18:37.496741 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.496615    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:37.501660 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.501630    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw"
Sep 11 21:18:37.512976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.512871    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-f2tgw" podStartSLOduration=2.045040587 podStartE2EDuration="3.51285114s" totalImagesPullingTime="1.467810553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:37.5114278 +0000 UTC m=+79.823653166" watchObservedRunningTime="2026-09-11 21:18:37.51285114 +0000 UTC m=+79.825076504"
Sep 11 21:18:37.623915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.623867    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:37.683573 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.683535    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"]
Sep 11 21:18:37.687138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.687111    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.689721 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.689701    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 21:18:37.689825 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.689771    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ctcgm\""
Sep 11 21:18:37.689825 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.689790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 21:18:37.689945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.689932    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 21:18:37.698040 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.698010    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"]
Sep 11 21:18:37.725320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.725281    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:37.771499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.771413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f833b0-78d0-49da-af5c-e6ccc7747e34-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.771499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.771470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.771711 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.771527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.771711 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.771653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c26sj\" (UniqueName: \"kubernetes.io/projected/e7f833b0-78d0-49da-af5c-e6ccc7747e34-kube-api-access-c26sj\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.872395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.872353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.872559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.872445    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c26sj\" (UniqueName: \"kubernetes.io/projected/e7f833b0-78d0-49da-af5c-e6ccc7747e34-kube-api-access-c26sj\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.872559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.872478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f833b0-78d0-49da-af5c-e6ccc7747e34-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.872559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.872516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.872726 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:37.872612    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 11 21:18:37.872726 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:37.872672    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-tls podName:e7f833b0-78d0-49da-af5c-e6ccc7747e34 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:38.372652798 +0000 UTC m=+80.684878162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-kfrhj" (UID: "e7f833b0-78d0-49da-af5c-e6ccc7747e34") : secret "prometheus-operator-tls" not found
Sep 11 21:18:37.873424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.873398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7f833b0-78d0-49da-af5c-e6ccc7747e34-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.875359 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.875336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.881505 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.881475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c26sj\" (UniqueName: \"kubernetes.io/projected/e7f833b0-78d0-49da-af5c-e6ccc7747e34-kube-api-access-c26sj\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:37.961757 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:37.961719    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:38.375815 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:38.375769    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:38.378479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:38.378454    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7f833b0-78d0-49da-af5c-e6ccc7747e34-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-kfrhj\" (UID: \"e7f833b0-78d0-49da-af5c-e6ccc7747e34\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:38.598142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:38.598105    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"
Sep 11 21:18:38.878285 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:38.878204    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj"]
Sep 11 21:18:38.881709 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:38.881663    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f833b0_78d0_49da_af5c_e6ccc7747e34.slice/crio-9704bdc072bec7e135858f443a3a0c18ae3eeb212ab114f4c0762388e9db9cdd WatchSource:0}: Error finding container 9704bdc072bec7e135858f443a3a0c18ae3eeb212ab114f4c0762388e9db9cdd: Status 404 returned error can't find the container with id 9704bdc072bec7e135858f443a3a0c18ae3eeb212ab114f4c0762388e9db9cdd
Sep 11 21:18:39.428245 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:39.428203    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:39.506000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:39.505959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj" event={"ID":"e7f833b0-78d0-49da-af5c-e6ccc7747e34","Type":"ContainerStarted","Data":"9704bdc072bec7e135858f443a3a0c18ae3eeb212ab114f4c0762388e9db9cdd"}
Sep 11 21:18:39.528739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:39.528699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:40.794630 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:40.794579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:40.895011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:40.894971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:40.957175 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:40.957137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:41.180224 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:41.180096    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:41.244385 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:41.244322    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:41.516619 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:41.516581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj" event={"ID":"e7f833b0-78d0-49da-af5c-e6ccc7747e34","Type":"ContainerStarted","Data":"c841ce7e8854930eb40c26495795b2e3542067cead86b80a87dc5839b40ddbc8"}
Sep 11 21:18:41.516804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:41.516649    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj" event={"ID":"e7f833b0-78d0-49da-af5c-e6ccc7747e34","Type":"ContainerStarted","Data":"5b5281441b47d39e24ca6b03fded059113cb3a25a9a61e52acfde4be668813b7"}
Sep 11 21:18:41.539784 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:41.539732    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-kfrhj" podStartSLOduration=2.960698766 podStartE2EDuration="4.539711146s" totalImagesPullingTime="1.57901238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:41.538188582 +0000 UTC m=+83.850413951" watchObservedRunningTime="2026-09-11 21:18:41.539711146 +0000 UTC m=+83.851936512"
Sep 11 21:18:42.632243 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:42.632183    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:42.808175 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:42.808140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.020247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.020209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.040839 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.040802    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"]
Sep 11 21:18:43.045710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.045685    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.048200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.048177    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 21:18:43.048363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.048333    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q9txj\""
Sep 11 21:18:43.048444 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.048360    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 21:18:43.059724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.059694    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"]
Sep 11 21:18:43.078033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.078003    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"]
Sep 11 21:18:43.081441 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.081419    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.084652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.084485    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sxwsk\""
Sep 11 21:18:43.084652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.084547    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 21:18:43.084652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.084494    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 21:18:43.084928 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.084913    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 21:18:43.093510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.093403    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pcpx6"]
Sep 11 21:18:43.097052 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.097030    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"]
Sep 11 21:18:43.097166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.097146    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.100085 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.100063    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 21:18:43.100184 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.100102    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 21:18:43.100682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.100661    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 21:18:43.100810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.100733    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4fgxn\""
Sep 11 21:18:43.119025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.118968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.119271 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.119042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l6lk\" (UniqueName: \"kubernetes.io/projected/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-kube-api-access-8l6lk\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.119271 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.119109    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.119271 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.119155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.121371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.121340    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.219773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.219733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.219773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.219779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-textfile\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.219931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.220030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.219968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tclb4\" (UniqueName: \"kubernetes.io/projected/7f06b564-3125-4d3f-b1d4-83977d090026-kube-api-access-tclb4\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.220030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.219996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-sys\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220014    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-tls\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220220 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-wtmp\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220220 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.220220 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-metrics-client-ca\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220389 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.220389 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220376    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220490 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220400    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.220490 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l6lk\" (UniqueName: \"kubernetes.io/projected/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-kube-api-access-8l6lk\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.220490 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65bs6\" (UniqueName: \"kubernetes.io/projected/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-kube-api-access-65bs6\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220490 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:43.220473    2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 11 21:18:43.220490 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.220727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220509    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-root\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220727 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:43.220539    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-tls podName:0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d nodeName:}" failed. No retries permitted until 2026-09-11 21:18:43.720518249 +0000 UTC m=+86.032743596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-g9qbj" (UID: "0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d") : secret "openshift-state-metrics-tls" not found
Sep 11 21:18:43.220727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220668    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7f06b564-3125-4d3f-b1d4-83977d090026-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.220727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f06b564-3125-4d3f-b1d4-83977d090026-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.220727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.220957 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.220900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.221800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.221763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.223166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.223146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.233521 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.233494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l6lk\" (UniqueName: \"kubernetes.io/projected/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-kube-api-access-8l6lk\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.321344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7f06b564-3125-4d3f-b1d4-83977d090026-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.321344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321297    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f06b564-3125-4d3f-b1d4-83977d090026-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.321344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321370    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-textfile\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321435    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tclb4\" (UniqueName: \"kubernetes.io/projected/7f06b564-3125-4d3f-b1d4-83977d090026-kube-api-access-tclb4\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-sys\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321693    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-tls\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-wtmp\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321735    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7f06b564-3125-4d3f-b1d4-83977d090026-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321808    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-sys\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-metrics-client-ca\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:43.321845    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321854    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-wtmp\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:18:43.321915    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-tls podName:c86c7814-5e47-4cfd-a17d-cf2b77ab9df2 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:43.821895337 +0000 UTC m=+86.134120698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-tls") pod "node-exporter-pcpx6" (UID: "c86c7814-5e47-4cfd-a17d-cf2b77ab9df2") : secret "node-exporter-tls" not found
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65bs6\" (UniqueName: \"kubernetes.io/projected/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-kube-api-access-65bs6\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.322634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322050    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-root\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322158    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-root\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.321942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-textfile\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322419    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-metrics-client-ca\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-accelerators-collector-config\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322780    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f06b564-3125-4d3f-b1d4-83977d090026-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.323343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.322790    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.324606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.324584    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.324889 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.324867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.324970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.324951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f06b564-3125-4d3f-b1d4-83977d090026-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.341137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.341106    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65bs6\" (UniqueName: \"kubernetes.io/projected/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-kube-api-access-65bs6\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.346887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.346855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tclb4\" (UniqueName: \"kubernetes.io/projected/7f06b564-3125-4d3f-b1d4-83977d090026-kube-api-access-tclb4\") pod \"kube-state-metrics-59fbdd77d-t2lpg\" (UID: \"7f06b564-3125-4d3f-b1d4-83977d090026\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.376975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.376936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.392226 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.392191    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"
Sep 11 21:18:43.478678 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.478642    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.575942 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.575850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.699881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.699846    2572 patch_prober.go:28] interesting pod/image-registry-844bf8659c-w2s47 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 21:18:43.700322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.699938    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" podUID="6e14b95a-2f45-4180-9237-540c64a8da0d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:18:43.725723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.725683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.727567 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.727513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.728780 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.728750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-g9qbj\" (UID: \"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:43.826576 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.826474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-tls\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.829019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.828995    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c86c7814-5e47-4cfd-a17d-cf2b77ab9df2-node-exporter-tls\") pod \"node-exporter-pcpx6\" (UID: \"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2\") " pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:43.915047 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.915009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:43.956728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:43.956695    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"
Sep 11 21:18:44.009002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:44.008964    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pcpx6"
Sep 11 21:18:44.160918 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:44.160810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:44.269493 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:44.269234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:44.434942 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:44.434861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:44.578271 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:44.578217    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:44.960786 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:44.960752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:45.177163 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.177125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:45.424134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.424106    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:18:45.583130 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.583101    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b5b666656-ptqv2"]
Sep 11 21:18:45.587036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.587010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.592229 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.592204    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 21:18:45.592395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.592376    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 21:18:45.592467 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.592388    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 21:18:45.592734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.592562    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 21:18:45.592734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.592590    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3p87s267bkbq1\""
Sep 11 21:18:45.593031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.593012    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-b9rj6\""
Sep 11 21:18:45.598583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.598565    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 21:18:45.640478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.640446    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b5b666656-ptqv2"]
Sep 11 21:18:45.745364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745587 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjmz5\" (UniqueName: \"kubernetes.io/projected/4a092328-917d-4899-9980-879cfeebbce1-kube-api-access-pjmz5\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745587 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745587 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-tls\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745587 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-grpc-tls\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.745800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.745630    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a092328-917d-4899-9980-879cfeebbce1-metrics-client-ca\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.846901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.846866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-grpc-tls\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.846907    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a092328-917d-4899-9980-879cfeebbce1-metrics-client-ca\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.846951    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.846993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.847028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmz5\" (UniqueName: \"kubernetes.io/projected/4a092328-917d-4899-9980-879cfeebbce1-kube-api-access-pjmz5\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847298 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.847087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847298 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.847114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-tls\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.847298 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.847139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.848041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.848015    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a092328-917d-4899-9980-879cfeebbce1-metrics-client-ca\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.850083 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.850054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.850382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.850359    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.850466 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.850403    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.850582 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.850555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-tls\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.850851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.850826    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-grpc-tls\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.850943 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.850921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4a092328-917d-4899-9980-879cfeebbce1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.861484 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.861459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmz5\" (UniqueName: \"kubernetes.io/projected/4a092328-917d-4899-9980-879cfeebbce1-kube-api-access-pjmz5\") pod \"thanos-querier-7b5b666656-ptqv2\" (UID: \"4a092328-917d-4899-9980-879cfeebbce1\") " pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.899348 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.899313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:18:45.903989 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:45.903953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:46.172664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:46.172632    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:46.325427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:46.325372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:46.579858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:46.579821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:46.805764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:46.805718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:46.927424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:46.927323    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:47.031827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.031786    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:47.710846 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.710814    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5854956bc9-ntmj7"]
Sep 11 21:18:47.716938 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.716913    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.720376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.720345    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 21:18:47.721398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.721231    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 21:18:47.721398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.721370    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ausgiaj81uu2u\""
Sep 11 21:18:47.721575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.721393    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wldqd\""
Sep 11 21:18:47.721575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.721523    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 21:18:47.721680 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.721627    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 21:18:47.726774 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.726752    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5854956bc9-ntmj7"]
Sep 11 21:18:47.846616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.846579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:47.865634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-secret-metrics-server-client-certs\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.865634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-metrics-server-audit-profiles\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.865862 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmb2r\" (UniqueName: \"kubernetes.io/projected/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-kube-api-access-pmb2r\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.865862 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-secret-metrics-server-tls\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.865862 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865825    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.865968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865873    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-client-ca-bundle\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.865968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.865932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-audit-log\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.906210 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.906165    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"]
Sep 11 21:18:47.925008 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.924976    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:47.925936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.925908    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"]
Sep 11 21:18:47.927799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.927762    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dh9gn\""
Sep 11 21:18:47.928055 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.928033    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 21:18:47.966660 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966579    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmb2r\" (UniqueName: \"kubernetes.io/projected/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-kube-api-access-pmb2r\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.966660 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-secret-metrics-server-tls\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.966895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.966895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966719    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-client-ca-bundle\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.966895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966750    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-audit-log\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.966895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-secret-metrics-server-client-certs\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.966895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.966830    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-metrics-server-audit-profiles\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.967500 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.967471    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-audit-log\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.967801 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.967773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.968176 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.968149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-metrics-server-audit-profiles\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.970115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.970051    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-secret-metrics-server-client-certs\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.970566 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.970541    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-client-ca-bundle\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.971025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.971002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-secret-metrics-server-tls\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:47.976962 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:47.976942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmb2r\" (UniqueName: \"kubernetes.io/projected/96a26303-b1e4-4ae3-978e-ee6263a3c8b0-kube-api-access-pmb2r\") pod \"metrics-server-5854956bc9-ntmj7\" (UID: \"96a26303-b1e4-4ae3-978e-ee6263a3c8b0\") " pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:48.028958 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.028921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:18:48.067536 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.067506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a4fd46f-5b2a-4295-a123-d94141e44908-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nwqwx\" (UID: \"4a4fd46f-5b2a-4295-a123-d94141e44908\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.067666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.067586    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tx4s\" (UniqueName: \"kubernetes.io/projected/4a4fd46f-5b2a-4295-a123-d94141e44908-kube-api-access-6tx4s\") pod \"monitoring-plugin-5d85778b9d-nwqwx\" (UID: \"4a4fd46f-5b2a-4295-a123-d94141e44908\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.082519 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.082476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:48.168540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.168502    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tx4s\" (UniqueName: \"kubernetes.io/projected/4a4fd46f-5b2a-4295-a123-d94141e44908-kube-api-access-6tx4s\") pod \"monitoring-plugin-5d85778b9d-nwqwx\" (UID: \"4a4fd46f-5b2a-4295-a123-d94141e44908\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.168727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.168566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a4fd46f-5b2a-4295-a123-d94141e44908-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nwqwx\" (UID: \"4a4fd46f-5b2a-4295-a123-d94141e44908\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.171437 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.171387    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a4fd46f-5b2a-4295-a123-d94141e44908-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nwqwx\" (UID: \"4a4fd46f-5b2a-4295-a123-d94141e44908\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.180842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.180816    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tx4s\" (UniqueName: \"kubernetes.io/projected/4a4fd46f-5b2a-4295-a123-d94141e44908-kube-api-access-6tx4s\") pod \"monitoring-plugin-5d85778b9d-nwqwx\" (UID: \"4a4fd46f-5b2a-4295-a123-d94141e44908\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.205520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.205487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:48.236849 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.236782    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:48.289410 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:48.288485    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86c7814_5e47_4cfd_a17d_cf2b77ab9df2.slice/crio-264aadc387beb88eaf88ccd78abc8966ac6a92754f80032cb2a123dc303d1764 WatchSource:0}: Error finding container 264aadc387beb88eaf88ccd78abc8966ac6a92754f80032cb2a123dc303d1764: Status 404 returned error can't find the container with id 264aadc387beb88eaf88ccd78abc8966ac6a92754f80032cb2a123dc303d1764
Sep 11 21:18:48.527612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.527574    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5896d849dc-kllvc"]
Sep 11 21:18:48.543873 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.543839    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.548806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.548756    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 21:18:48.548964 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.548853    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 21:18:48.548964 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.548867    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 21:18:48.549088 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.549003    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 21:18:48.549088 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.548757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpx6" event={"ID":"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2","Type":"ContainerStarted","Data":"264aadc387beb88eaf88ccd78abc8966ac6a92754f80032cb2a123dc303d1764"}
Sep 11 21:18:48.549516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.549452    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 21:18:48.549676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.549644    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-splp2\""
Sep 11 21:18:48.557167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.557144    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5896d849dc-kllvc"]
Sep 11 21:18:48.572062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.572038    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 21:18:48.585752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.585725    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj"]
Sep 11 21:18:48.591830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.591810    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5854956bc9-ntmj7"]
Sep 11 21:18:48.596215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.596188    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg"]
Sep 11 21:18:48.597584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.597565    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"]
Sep 11 21:18:48.616983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.616963    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b5b666656-ptqv2"]
Sep 11 21:18:48.626515 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:48.626479    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd20998_5dd2_4dd4_8f6c_0c7dfb559f8d.slice/crio-d75c1aec7fa9194b89e31b2e0bd6966771fcbc68ca07383a36b44b09f16aa126 WatchSource:0}: Error finding container d75c1aec7fa9194b89e31b2e0bd6966771fcbc68ca07383a36b44b09f16aa126: Status 404 returned error can't find the container with id d75c1aec7fa9194b89e31b2e0bd6966771fcbc68ca07383a36b44b09f16aa126
Sep 11 21:18:48.627061 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:48.627040    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a26303_b1e4_4ae3_978e_ee6263a3c8b0.slice/crio-646a28bccad6a21212f1b034d5b66e89fba18a80352807fcc9a0c1bf5255aa1b WatchSource:0}: Error finding container 646a28bccad6a21212f1b034d5b66e89fba18a80352807fcc9a0c1bf5255aa1b: Status 404 returned error can't find the container with id 646a28bccad6a21212f1b034d5b66e89fba18a80352807fcc9a0c1bf5255aa1b
Sep 11 21:18:48.627938 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:48.627835    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4fd46f_5b2a_4295_a123_d94141e44908.slice/crio-248e688da6b591fcf82e6018eb26f4eab43941f4c700618eac6a333badfb2999 WatchSource:0}: Error finding container 248e688da6b591fcf82e6018eb26f4eab43941f4c700618eac6a333badfb2999: Status 404 returned error can't find the container with id 248e688da6b591fcf82e6018eb26f4eab43941f4c700618eac6a333badfb2999
Sep 11 21:18:48.628758 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:48.628733    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f06b564_3125_4d3f_b1d4_83977d090026.slice/crio-756ae86f8242bdd2735b97b7512ea985d8bd5aab6d5ba39299e0f82ba01cf3e1 WatchSource:0}: Error finding container 756ae86f8242bdd2735b97b7512ea985d8bd5aab6d5ba39299e0f82ba01cf3e1: Status 404 returned error can't find the container with id 756ae86f8242bdd2735b97b7512ea985d8bd5aab6d5ba39299e0f82ba01cf3e1
Sep 11 21:18:48.630166 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:18:48.630137    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a092328_917d_4899_9980_879cfeebbce1.slice/crio-9ba96b730a33f43787b8da1a1fb97a27d30d2155abd06c3d031df07d3fe5da3d WatchSource:0}: Error finding container 9ba96b730a33f43787b8da1a1fb97a27d30d2155abd06c3d031df07d3fe5da3d: Status 404 returned error can't find the container with id 9ba96b730a33f43787b8da1a1fb97a27d30d2155abd06c3d031df07d3fe5da3d
Sep 11 21:18:48.676984 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.676953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-federate-client-tls\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677085 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphrj\" (UniqueName: \"kubernetes.io/projected/58536a91-52ca-47cd-9749-f18bb29325cc-kube-api-access-wphrj\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677085 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-secret-telemeter-client\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677085 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677064    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-metrics-client-ca\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-telemeter-client-tls\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-serving-certs-ca-bundle\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.677428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.677241    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.778925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.778997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-federate-client-tls\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphrj\" (UniqueName: \"kubernetes.io/projected/58536a91-52ca-47cd-9749-f18bb29325cc-kube-api-access-wphrj\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-secret-telemeter-client\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-metrics-client-ca\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-telemeter-client-tls\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-serving-certs-ca-bundle\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.779878    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-serving-certs-ca-bundle\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.780185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.780050    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.781788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.781762    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58536a91-52ca-47cd-9749-f18bb29325cc-metrics-client-ca\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.782009 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.781982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.784441 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.784393    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-secret-telemeter-client\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.784441 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.784422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-federate-client-tls\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.784748 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.784729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58536a91-52ca-47cd-9749-f18bb29325cc-telemeter-client-tls\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.793151 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.793133    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphrj\" (UniqueName: \"kubernetes.io/projected/58536a91-52ca-47cd-9749-f18bb29325cc-kube-api-access-wphrj\") pod \"telemeter-client-5896d849dc-kllvc\" (UID: \"58536a91-52ca-47cd-9749-f18bb29325cc\") " pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:48.855767 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:48.855731    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc"
Sep 11 21:18:49.153416 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.153284    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5896d849dc-kllvc"]
Sep 11 21:18:49.557534 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.557443    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg" event={"ID":"7f06b564-3125-4d3f-b1d4-83977d090026","Type":"ContainerStarted","Data":"756ae86f8242bdd2735b97b7512ea985d8bd5aab6d5ba39299e0f82ba01cf3e1"}
Sep 11 21:18:49.559749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.559718    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"9ba96b730a33f43787b8da1a1fb97a27d30d2155abd06c3d031df07d3fe5da3d"}
Sep 11 21:18:49.563296 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.563243    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7" event={"ID":"96a26303-b1e4-4ae3-978e-ee6263a3c8b0","Type":"ContainerStarted","Data":"646a28bccad6a21212f1b034d5b66e89fba18a80352807fcc9a0c1bf5255aa1b"}
Sep 11 21:18:49.567445 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.567415    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj" event={"ID":"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d","Type":"ContainerStarted","Data":"21fa5b769c863cd59c86086a69e3909249ace4f4e738b0c788918587ff2a34ab"}
Sep 11 21:18:49.567565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.567473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj" event={"ID":"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d","Type":"ContainerStarted","Data":"20c6bbed34385dfdfe287519cf7e9c54e716c1b99e73f97e93bdc22c45d14735"}
Sep 11 21:18:49.567565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.567502    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj" event={"ID":"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d","Type":"ContainerStarted","Data":"d75c1aec7fa9194b89e31b2e0bd6966771fcbc68ca07383a36b44b09f16aa126"}
Sep 11 21:18:49.570775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.570737    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx" event={"ID":"4a4fd46f-5b2a-4295-a123-d94141e44908","Type":"ContainerStarted","Data":"248e688da6b591fcf82e6018eb26f4eab43941f4c700618eac6a333badfb2999"}
Sep 11 21:18:49.572641 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.572577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qztkg" event={"ID":"8c3a8259-ada8-4167-a187-c3875098b2e9","Type":"ContainerStarted","Data":"a4465c3d7538ae801c56faf3e423c9e6d3c6a731790ade689c549880ef8b8309"}
Sep 11 21:18:49.572991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.572965    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:49.593319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.593112    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-qztkg"
Sep 11 21:18:49.596293 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.594560    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-qztkg" podStartSLOduration=1.7069325549999999 podStartE2EDuration="18.594539641s" totalImagesPullingTime="16.887607086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:49.593852752 +0000 UTC m=+91.906078118" watchObservedRunningTime="2026-09-11 21:18:49.594539641 +0000 UTC m=+91.906765009"
Sep 11 21:18:49.735619 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:49.735536    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:50.001266 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:50.001119    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:50.494041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:50.493953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:50.580937 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:50.580853    2572 generic.go:356] "Generic (PLEG): container finished" podID="c86c7814-5e47-4cfd-a17d-cf2b77ab9df2" containerID="1212f95f8e215c25e12e6b8c825b05afff5fadef9608c877ea7f5fe43defdf6e" exitCode=0
Sep 11 21:18:50.581094 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:50.580941    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpx6" event={"ID":"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2","Type":"ContainerDied","Data":"1212f95f8e215c25e12e6b8c825b05afff5fadef9608c877ea7f5fe43defdf6e"}
Sep 11 21:18:50.585977 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:50.585909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc" event={"ID":"58536a91-52ca-47cd-9749-f18bb29325cc","Type":"ContainerStarted","Data":"1109fe9fd31df5ef055a401e6fc08407f6c905e896442dc495ac5cf605f10156"}
Sep 11 21:18:50.591797 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:50.591770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:51.076385 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:51.076333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:51.174787 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:51.174749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:51.275225 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:51.275049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:53.813059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:53.812921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:53.917051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:53.917008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:54.782043 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:54.782004    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844bf8659c-w2s47"]
Sep 11 21:18:54.892799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:54.892762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:54.991773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:54.991732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:55.605569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:55.605535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:55.617650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:55.617564    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpx6" event={"ID":"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2","Type":"ContainerStarted","Data":"aca685ed1e70557588168606cd14eef402f7b477cb3503b4f3d9b3fcf761c8d2"}
Sep 11 21:18:55.709312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:55.709032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:56.633276 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.632325    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg" event={"ID":"7f06b564-3125-4d3f-b1d4-83977d090026","Type":"ContainerStarted","Data":"ac1cd16148201871906bd8bf6c3a331871cc024165c364a4051043ae47dbf615"}
Sep 11 21:18:56.633276 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.632400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg" event={"ID":"7f06b564-3125-4d3f-b1d4-83977d090026","Type":"ContainerStarted","Data":"f2b111506f645dce3d4e177be9125cf758eb90dd33f23c0569445f9f3cbc7928"}
Sep 11 21:18:56.633276 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.632428    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg" event={"ID":"7f06b564-3125-4d3f-b1d4-83977d090026","Type":"ContainerStarted","Data":"2852c5bfccdd9153fac097c75cb6f7797f44a7ce74556c05204485661a0bc76a"}
Sep 11 21:18:56.636740 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.636685    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"8e8c7330b9b55d34e8b58a6942b3ffbd6875c0ee4f93c03a147ecff007d7eacd"}
Sep 11 21:18:56.636874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.636762    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"c737aef4b1be72480bc2d51c269b45fb65cffcc700c63312e03d8166ec8b8c4c"}
Sep 11 21:18:56.636874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.636807    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"ac31eb48c274758e6e1f1c391ea5f9fae55c645e4a749044cfff27202a215bf8"}
Sep 11 21:18:56.641213 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.639867    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7" event={"ID":"96a26303-b1e4-4ae3-978e-ee6263a3c8b0","Type":"ContainerStarted","Data":"6b37cfed26d8339ff9233f42e8ae4e7ecfa0d30e26c74e298b1a3e9e5614793b"}
Sep 11 21:18:56.647246 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.646539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pcpx6" event={"ID":"c86c7814-5e47-4cfd-a17d-cf2b77ab9df2","Type":"ContainerStarted","Data":"fd1ef0d2ce861d59e4746c0101c8df55fd5119c6e208bae3b5575c8e5b03d880"}
Sep 11 21:18:56.652976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.652664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj" event={"ID":"0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d","Type":"ContainerStarted","Data":"e19e9993d880bb5245e59c7e68a19aef8e3c35df2df78676f29a999241486411"}
Sep 11 21:18:56.656241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.656211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc" event={"ID":"58536a91-52ca-47cd-9749-f18bb29325cc","Type":"ContainerStarted","Data":"55d2b75082b85cb690c29c0a5b74a3efc656cba06f2637b9fca6b0031e205740"}
Sep 11 21:18:56.657531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.657445    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-t2lpg" podStartSLOduration=6.855088661 podStartE2EDuration="13.657425662s" totalImagesPullingTime="6.802337001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:56.655534118 +0000 UTC m=+98.967759508" watchObservedRunningTime="2026-09-11 21:18:56.657425662 +0000 UTC m=+98.969651029"
Sep 11 21:18:56.659728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.658850    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx" event={"ID":"4a4fd46f-5b2a-4295-a123-d94141e44908","Type":"ContainerStarted","Data":"5be42fe86240639603c5cd754b5f52e69240902d7a0a55a313ab77c17ac2dce8"}
Sep 11 21:18:56.659728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.659682    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:56.667354 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.667329    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx"
Sep 11 21:18:56.681658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.681603    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7" podStartSLOduration=2.879362452 podStartE2EDuration="9.681587488s" totalImagesPullingTime="6.802225036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:56.680501206 +0000 UTC m=+98.992726596" watchObservedRunningTime="2026-09-11 21:18:56.681587488 +0000 UTC m=+98.993812854"
Sep 11 21:18:56.700580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.700526    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pcpx6" podStartSLOduration=11.951674428 podStartE2EDuration="13.700510276s" totalImagesPullingTime="1.577938336s" totalInitContainerRuntime="170.897512ms" isStatefulPod=true podCreationTimestamp="2026-09-11 21:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:56.700190336 +0000 UTC m=+99.012415705" watchObservedRunningTime="2026-09-11 21:18:56.700510276 +0000 UTC m=+99.012735641"
Sep 11 21:18:56.720820 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.720755    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-g9qbj" podStartSLOduration=7.057312529 podStartE2EDuration="13.720732529s" totalImagesPullingTime="6.66342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:56.719480492 +0000 UTC m=+99.031705861" watchObservedRunningTime="2026-09-11 21:18:56.720732529 +0000 UTC m=+99.032957923"
Sep 11 21:18:56.739700 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:56.739640    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nwqwx" podStartSLOduration=2.936360717 podStartE2EDuration="9.73961974s" totalImagesPullingTime="6.803259023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:56.738902435 +0000 UTC m=+99.051127809" watchObservedRunningTime="2026-09-11 21:18:56.73961974 +0000 UTC m=+99.051845106"
Sep 11 21:18:57.995288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:57.995234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:58.051469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.051373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:58.668435 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.668399    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc" event={"ID":"58536a91-52ca-47cd-9749-f18bb29325cc","Type":"ContainerStarted","Data":"6aef53fa643c1b1889ab4fddc4ffc9eb13df4b3ace12410bb15d1b83c56e5dd0"}
Sep 11 21:18:58.668733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.668468    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc" event={"ID":"58536a91-52ca-47cd-9749-f18bb29325cc","Type":"ContainerStarted","Data":"bfbef357c7ed0ce068338a39994bb1a02254edf7a95a879d9899de611b3aa8b2"}
Sep 11 21:18:58.671140 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.671111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"96d95de907392c2161458fc15c802b413292dcfb28bb1b75841fe3244a5790b9"}
Sep 11 21:18:58.671267 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.671169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"15a08e77fc3e0245e754d99b60e15b171ee46b194688be6cfc3151fc8c6494ea"}
Sep 11 21:18:58.671267 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.671200    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" event={"ID":"4a092328-917d-4899-9980-879cfeebbce1","Type":"ContainerStarted","Data":"7db8a707c40eb910f9a435df5a8f922fca419f43851d5103027cbb30d46825c7"}
Sep 11 21:18:58.689995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.689934    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5896d849dc-kllvc" podStartSLOduration=2.975502234 podStartE2EDuration="10.689915269s" totalImagesPullingTime="7.714413035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:58.689884202 +0000 UTC m=+101.002109584" watchObservedRunningTime="2026-09-11 21:18:58.689915269 +0000 UTC m=+101.002140637"
Sep 11 21:18:58.718270 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.718181    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2" podStartSLOduration=5.370732643 podStartE2EDuration="13.718154874s" totalImagesPullingTime="8.347422231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:58.716990508 +0000 UTC m=+101.029215874" watchObservedRunningTime="2026-09-11 21:18:58.718154874 +0000 UTC m=+101.030380240"
Sep 11 21:18:58.993417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:58.993328    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.060558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:59.060515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.140970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:59.140933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.210518 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:59.210478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.586727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:59.586683    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.675670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:18:59.675642    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:19:00.685754 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:00.685726    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b5b666656-ptqv2"
Sep 11 21:19:01.461273 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:01.461218    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n9v9k"
Sep 11 21:19:02.799082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:02.799047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:02.877167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:02.877125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:06.218887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:06.218852    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:06.360519 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:06.360481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:08.030032 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:08.029982    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:19:08.030432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:08.030057    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:19:09.591703 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:09.591667    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:09.664765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:09.664733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:09.725002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:09.724970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:14.137230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:14.137192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:14.200301 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:14.200247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:19.814233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:19.814164    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" podUID="6e14b95a-2f45-4180-9237-540c64a8da0d" containerName="registry" containerID="cri-o://7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6" gracePeriod=30
Sep 11 21:19:20.049297 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.049273    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:19:20.182474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182385    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182433    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-installation-pull-secrets\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182464    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-trusted-ca\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182645    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-image-registry-private-configuration\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182700    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-bound-sa-token\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182729    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e14b95a-2f45-4180-9237-540c64a8da0d-ca-trust-extracted\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182821 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182783    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g2m8\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-kube-api-access-5g2m8\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182821 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182812    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-certificates\") pod \"6e14b95a-2f45-4180-9237-540c64a8da0d\" (UID: \"6e14b95a-2f45-4180-9237-540c64a8da0d\") "
Sep 11 21:19:20.182929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.182850    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:20.183083 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.183062    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-trusted-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.183475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.183450    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:20.185139 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.185093    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:20.185274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.185133    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:20.185274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.185163    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:20.185274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.185231    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:20.185443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.185315    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-kube-api-access-5g2m8" (OuterVolumeSpecName: "kube-api-access-5g2m8") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "kube-api-access-5g2m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:20.190885 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.190847    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e14b95a-2f45-4180-9237-540c64a8da0d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6e14b95a-2f45-4180-9237-540c64a8da0d" (UID: "6e14b95a-2f45-4180-9237-540c64a8da0d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:19:20.283632 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283597    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-image-registry-private-configuration\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.283632 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283626    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-bound-sa-token\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.283632 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283636    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e14b95a-2f45-4180-9237-540c64a8da0d-ca-trust-extracted\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.283845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283645    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g2m8\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-kube-api-access-5g2m8\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.283845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283654    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-certificates\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.283845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283663    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e14b95a-2f45-4180-9237-540c64a8da0d-registry-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.283845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.283673    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e14b95a-2f45-4180-9237-540c64a8da0d-installation-pull-secrets\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:19:20.761378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.761348    2572 generic.go:356] "Generic (PLEG): container finished" podID="6e14b95a-2f45-4180-9237-540c64a8da0d" containerID="7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6" exitCode=0
Sep 11 21:19:20.761556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.761397    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844bf8659c-w2s47"
Sep 11 21:19:20.761556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.761432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" event={"ID":"6e14b95a-2f45-4180-9237-540c64a8da0d","Type":"ContainerDied","Data":"7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6"}
Sep 11 21:19:20.761556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.761481    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844bf8659c-w2s47" event={"ID":"6e14b95a-2f45-4180-9237-540c64a8da0d","Type":"ContainerDied","Data":"82118d073b8da4c997e599785c56d1ceff9411a4de371398f9be8978188b025a"}
Sep 11 21:19:20.761556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.761502    2572 scope.go:117] "RemoveContainer" containerID="7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6"
Sep 11 21:19:20.772329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.772307    2572 scope.go:117] "RemoveContainer" containerID="7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6"
Sep 11 21:19:20.772693 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:19:20.772673    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6\": container with ID starting with 7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6 not found: ID does not exist" containerID="7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6"
Sep 11 21:19:20.772765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.772702    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6"} err="failed to get container status \"7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6\": rpc error: code = NotFound desc = could not find container \"7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6\": container with ID starting with 7c57853323efbef07fa9cad0d73ca8916e4708d70cda87bd6d35440ab12479d6 not found: ID does not exist"
Sep 11 21:19:20.789014 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.788983    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844bf8659c-w2s47"]
Sep 11 21:19:20.792351 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:20.792331    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-844bf8659c-w2s47"]
Sep 11 21:19:22.142769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:22.142731    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e14b95a-2f45-4180-9237-540c64a8da0d" path="/var/lib/kubelet/pods/6e14b95a-2f45-4180-9237-540c64a8da0d/volumes"
Sep 11 21:19:28.034350 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:28.034320    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:19:28.038105 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:28.038076    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5854956bc9-ntmj7"
Sep 11 21:19:38.268158 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:38.268122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:38.338297 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:38.338261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:59.732567 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:59.732533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:59.795184 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:19:59.795147    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:05.763559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.763524    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:20:05.763972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.763949    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e14b95a-2f45-4180-9237-540c64a8da0d" containerName="registry"
Sep 11 21:20:05.763972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.763972    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e14b95a-2f45-4180-9237-540c64a8da0d" containerName="registry"
Sep 11 21:20:05.764079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.764054    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e14b95a-2f45-4180-9237-540c64a8da0d" containerName="registry"
Sep 11 21:20:05.768625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.768604    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.771191 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 21:20:05.771332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 21:20:05.771332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771164    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 21:20:05.771332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771174    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 21:20:05.771501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771464    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 21:20:05.771541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771525    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 21:20:05.771834 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.771820    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 21:20:05.772183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.772167    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 21:20:05.772339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.772326    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sq7cw\""
Sep 11 21:20:05.777508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.777489    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 21:20:05.780280 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.780241    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:20:05.875672 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875672 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875674    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875717    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875776    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-web-config\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrw57\" (UniqueName: \"kubernetes.io/projected/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-kube-api-access-lrw57\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.875880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875856    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-config-out\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.876067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.876067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.876067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875956    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.876067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.875970    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.876067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.876012    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976700    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-web-config\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrw57\" (UniqueName: \"kubernetes.io/projected/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-kube-api-access-lrw57\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-config-out\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.976878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976926    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.976994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.977044    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.977087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.977139    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.977823 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.977798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.978706 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.978614    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.980076 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.980029    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-config-out\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.980289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.980243    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.980365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.980326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.980365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.980351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.980453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.980377    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.980646 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.980628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.981149 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.981129    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-web-config\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.981227 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.981201    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.981470 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.981447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:05.985781 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:05.985760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrw57\" (UniqueName: \"kubernetes.io/projected/67b5574b-9e6f-40e6-9f7c-1a9932595e9d-kube-api-access-lrw57\") pod \"alertmanager-main-0\" (UID: \"67b5574b-9e6f-40e6-9f7c-1a9932595e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:06.079740 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:06.079659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:20:06.360170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:06.360089    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:20:06.363212 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:20:06.363186    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b5574b_9e6f_40e6_9f7c_1a9932595e9d.slice/crio-fce9f2bb1629732278a8cfcf60356ff52ac052f49d5651b8d2ee1fd5e60a26b8 WatchSource:0}: Error finding container fce9f2bb1629732278a8cfcf60356ff52ac052f49d5651b8d2ee1fd5e60a26b8: Status 404 returned error can't find the container with id fce9f2bb1629732278a8cfcf60356ff52ac052f49d5651b8d2ee1fd5e60a26b8
Sep 11 21:20:06.972743 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:06.972671    2572 generic.go:356] "Generic (PLEG): container finished" podID="67b5574b-9e6f-40e6-9f7c-1a9932595e9d" containerID="18f6944e651a64491c499b734a6163d231a890cd498a08482dd64cc787bb4714" exitCode=0
Sep 11 21:20:06.973169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:06.972755    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerDied","Data":"18f6944e651a64491c499b734a6163d231a890cd498a08482dd64cc787bb4714"}
Sep 11 21:20:06.973169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:06.972877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"fce9f2bb1629732278a8cfcf60356ff52ac052f49d5651b8d2ee1fd5e60a26b8"}
Sep 11 21:20:08.986473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:08.986440    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"26615f7d608b2868ec85beac4d9df806b1d22926b0c6fff541bba18228895715"}
Sep 11 21:20:08.986829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:08.986515    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"d205e539ad67f717468741c50df13d83e72676f3020ac7008b0af59e0a390b10"}
Sep 11 21:20:08.986829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:08.986542    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"9e4993c81d30316908ec720b5aeca8c13eacfb5f6347b487cf5d5c44b66218eb"}
Sep 11 21:20:08.986829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:08.986568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"ed586fb2a91664d2a100f3fa1cd082e1537b323efec2e14e93a83042b4a9517d"}
Sep 11 21:20:08.986829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:08.986591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"994d49a674f91cd4ca409a018c9b6ad1a34ba00ca8a3f385ac94be3740c68674"}
Sep 11 21:20:08.986829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:08.986614    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67b5574b-9e6f-40e6-9f7c-1a9932595e9d","Type":"ContainerStarted","Data":"4166f9d7e9fb5eab377209c27d2219745fe3a65accb67401187d66086c958a6a"}
Sep 11 21:20:09.018375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:09.018310    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.429248757 podStartE2EDuration="4.018288639s" totalImagesPullingTime="1.573753215s" totalInitContainerRuntime="15.286667ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:20:09.016604256 +0000 UTC m=+171.328829634" watchObservedRunningTime="2026-09-11 21:20:09.018288639 +0000 UTC m=+171.330514004"
Sep 11 21:20:11.622840 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:11.622744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:11.680234 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:11.680190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:14.137586 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:14.137550    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:14.198456 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:14.198409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:21.993542 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:21.993502    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.168821 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:29.168783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.267417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:29.267383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:33.102338 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:33.102308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:33.202033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:33.201994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:33.262468 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:33.262437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:51.540811 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:51.540766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:51.646241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:51.646205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:52.330413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.330370    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"]
Sep 11 21:20:52.333338 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.333314    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.336223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.336200    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:20:52.337235 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.337218    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n5pvq\""
Sep 11 21:20:52.337346 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.337274    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:20:52.341827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.341804    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"]
Sep 11 21:20:52.370867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.370823    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.371059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.370882    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7ffl\" (UniqueName: \"kubernetes.io/projected/fa0c6061-4ef4-44d1-8b06-39c04774851f-kube-api-access-f7ffl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.371059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.370912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.471601 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.471560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.471795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.471642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.471795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.471672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7ffl\" (UniqueName: \"kubernetes.io/projected/fa0c6061-4ef4-44d1-8b06-39c04774851f-kube-api-access-f7ffl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.472023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.471998    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.472093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.472026    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.480120 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.480094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7ffl\" (UniqueName: \"kubernetes.io/projected/fa0c6061-4ef4-44d1-8b06-39c04774851f-kube-api-access-f7ffl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.643641 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.643557    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:20:52.912148 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:52.912118    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"]
Sep 11 21:20:52.914524 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:20:52.914494    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0c6061_4ef4_44d1_8b06_39c04774851f.slice/crio-0745b68ece7bc54ce82ff12f7c3872293041af95090c3b7f83215203fe0272ff WatchSource:0}: Error finding container 0745b68ece7bc54ce82ff12f7c3872293041af95090c3b7f83215203fe0272ff: Status 404 returned error can't find the container with id 0745b68ece7bc54ce82ff12f7c3872293041af95090c3b7f83215203fe0272ff
Sep 11 21:20:53.172579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:53.172490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq" event={"ID":"fa0c6061-4ef4-44d1-8b06-39c04774851f","Type":"ContainerStarted","Data":"0745b68ece7bc54ce82ff12f7c3872293041af95090c3b7f83215203fe0272ff"}
Sep 11 21:20:56.106155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:56.106113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:56.159696 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:20:56.159667    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:00.208222 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:00.208188    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerID="c882c0a79a0f56db8394623f2bce41816942d5b9ef779fffb46b8381baebdd8d" exitCode=0
Sep 11 21:21:00.208606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:00.208264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq" event={"ID":"fa0c6061-4ef4-44d1-8b06-39c04774851f","Type":"ContainerDied","Data":"c882c0a79a0f56db8394623f2bce41816942d5b9ef779fffb46b8381baebdd8d"}
Sep 11 21:21:03.224668 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:03.224633    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerID="07bb23826f63b5e42448149692539bb53478e903f5ac497a1eb36ed0ae0bb108" exitCode=0
Sep 11 21:21:03.225113 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:03.224699    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq" event={"ID":"fa0c6061-4ef4-44d1-8b06-39c04774851f","Type":"ContainerDied","Data":"07bb23826f63b5e42448149692539bb53478e903f5ac497a1eb36ed0ae0bb108"}
Sep 11 21:21:11.264800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:11.264764    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerID="aa9ad86ff90204ba05248d1e3e9aecfd90d7c74445d37d2b82743e2305566c80" exitCode=0
Sep 11 21:21:11.265208 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:11.264844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq" event={"ID":"fa0c6061-4ef4-44d1-8b06-39c04774851f","Type":"ContainerDied","Data":"aa9ad86ff90204ba05248d1e3e9aecfd90d7c74445d37d2b82743e2305566c80"}
Sep 11 21:21:12.388941 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.388916    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:21:12.450739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.450708    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-bundle\") pod \"fa0c6061-4ef4-44d1-8b06-39c04774851f\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") "
Sep 11 21:21:12.450901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.450778    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7ffl\" (UniqueName: \"kubernetes.io/projected/fa0c6061-4ef4-44d1-8b06-39c04774851f-kube-api-access-f7ffl\") pod \"fa0c6061-4ef4-44d1-8b06-39c04774851f\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") "
Sep 11 21:21:12.450901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.450808    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-util\") pod \"fa0c6061-4ef4-44d1-8b06-39c04774851f\" (UID: \"fa0c6061-4ef4-44d1-8b06-39c04774851f\") "
Sep 11 21:21:12.451459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.451422    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-bundle" (OuterVolumeSpecName: "bundle") pod "fa0c6061-4ef4-44d1-8b06-39c04774851f" (UID: "fa0c6061-4ef4-44d1-8b06-39c04774851f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:21:12.453001 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.452967    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa0c6061-4ef4-44d1-8b06-39c04774851f-kube-api-access-f7ffl" (OuterVolumeSpecName: "kube-api-access-f7ffl") pod "fa0c6061-4ef4-44d1-8b06-39c04774851f" (UID: "fa0c6061-4ef4-44d1-8b06-39c04774851f"). InnerVolumeSpecName "kube-api-access-f7ffl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:21:12.455595 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.455567    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-util" (OuterVolumeSpecName: "util") pod "fa0c6061-4ef4-44d1-8b06-39c04774851f" (UID: "fa0c6061-4ef4-44d1-8b06-39c04774851f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:21:12.551531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.551444    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:12.551531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.551474    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7ffl\" (UniqueName: \"kubernetes.io/projected/fa0c6061-4ef4-44d1-8b06-39c04774851f-kube-api-access-f7ffl\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:12.551531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:12.551484    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa0c6061-4ef4-44d1-8b06-39c04774851f-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:13.276119 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:13.276087    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq"
Sep 11 21:21:13.276319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:13.276091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zgmwq" event={"ID":"fa0c6061-4ef4-44d1-8b06-39c04774851f","Type":"ContainerDied","Data":"0745b68ece7bc54ce82ff12f7c3872293041af95090c3b7f83215203fe0272ff"}
Sep 11 21:21:13.276319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:13.276206    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0745b68ece7bc54ce82ff12f7c3872293041af95090c3b7f83215203fe0272ff"
Sep 11 21:21:17.182062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:17.182024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:18.607782 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:18.607740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:18.959021 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:18.958937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:20.754424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754389    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"]
Sep 11 21:21:20.754848 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754828    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="pull"
Sep 11 21:21:20.754936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754852    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="pull"
Sep 11 21:21:20.754936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754875    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="extract"
Sep 11 21:21:20.754936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754881    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="extract"
Sep 11 21:21:20.754936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754894    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="util"
Sep 11 21:21:20.754936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754899    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="util"
Sep 11 21:21:20.755114 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.754969    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa0c6061-4ef4-44d1-8b06-39c04774851f" containerName="extract"
Sep 11 21:21:20.758427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.758409    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:20.761146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.761118    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-knpt7\""
Sep 11 21:21:20.761373 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.761356    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 21:21:20.761516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.761500    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:21:20.775146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.775123    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"]
Sep 11 21:21:20.923105 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.923061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptb8z\" (UniqueName: \"kubernetes.io/projected/00559a0d-a3f7-48e7-a779-be1097aa3f63-kube-api-access-ptb8z\") pod \"cert-manager-operator-controller-manager-55c444bf86-vblk7\" (UID: \"00559a0d-a3f7-48e7-a779-be1097aa3f63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:20.923310 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:20.923130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00559a0d-a3f7-48e7-a779-be1097aa3f63-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vblk7\" (UID: \"00559a0d-a3f7-48e7-a779-be1097aa3f63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:21.024152 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:21.024077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptb8z\" (UniqueName: \"kubernetes.io/projected/00559a0d-a3f7-48e7-a779-be1097aa3f63-kube-api-access-ptb8z\") pod \"cert-manager-operator-controller-manager-55c444bf86-vblk7\" (UID: \"00559a0d-a3f7-48e7-a779-be1097aa3f63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:21.024152 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:21.024143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00559a0d-a3f7-48e7-a779-be1097aa3f63-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vblk7\" (UID: \"00559a0d-a3f7-48e7-a779-be1097aa3f63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:21.024633 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:21.024615    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00559a0d-a3f7-48e7-a779-be1097aa3f63-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vblk7\" (UID: \"00559a0d-a3f7-48e7-a779-be1097aa3f63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:21.035228 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:21.035208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptb8z\" (UniqueName: \"kubernetes.io/projected/00559a0d-a3f7-48e7-a779-be1097aa3f63-kube-api-access-ptb8z\") pod \"cert-manager-operator-controller-manager-55c444bf86-vblk7\" (UID: \"00559a0d-a3f7-48e7-a779-be1097aa3f63\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:21.067211 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:21.067173    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"
Sep 11 21:21:21.347594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:21.347565    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7"]
Sep 11 21:21:21.348358 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:21:21.348312    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00559a0d_a3f7_48e7_a779_be1097aa3f63.slice/crio-6782a40ffa5fa516e93342fe39c7a64fe85e46a875a5802ede4b549a9f5d422f WatchSource:0}: Error finding container 6782a40ffa5fa516e93342fe39c7a64fe85e46a875a5802ede4b549a9f5d422f: Status 404 returned error can't find the container with id 6782a40ffa5fa516e93342fe39c7a64fe85e46a875a5802ede4b549a9f5d422f
Sep 11 21:21:22.314959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:22.314924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7" event={"ID":"00559a0d-a3f7-48e7-a779-be1097aa3f63","Type":"ContainerStarted","Data":"6782a40ffa5fa516e93342fe39c7a64fe85e46a875a5802ede4b549a9f5d422f"}
Sep 11 21:21:22.434655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:22.434611    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:22.533129 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:22.533095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:23.322004 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:23.321965    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7" event={"ID":"00559a0d-a3f7-48e7-a779-be1097aa3f63","Type":"ContainerStarted","Data":"143fe909200c6bbf93c90c475bd70b1befb5d09befe5fa5371a37ef9a858623b"}
Sep 11 21:21:23.367371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:23.367317    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vblk7" podStartSLOduration=1.495690013 podStartE2EDuration="3.367301165s" totalImagesPullingTime="1.871611152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:23.365928944 +0000 UTC m=+245.678154310" watchObservedRunningTime="2026-09-11 21:21:23.367301165 +0000 UTC m=+245.679526530"
Sep 11 21:21:23.851559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:23.851527    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:24.034003 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.033952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:24.207305 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.202957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:24.414003 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.413971    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lktnz"]
Sep 11 21:21:24.416414 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.416395    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.423812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.423791    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 21:21:24.424812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.424793    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 21:21:24.424867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.424793    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pf2m9\""
Sep 11 21:21:24.442931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.442896    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lktnz"]
Sep 11 21:21:24.557341 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.557306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh7m8\" (UniqueName: \"kubernetes.io/projected/0ff234fa-928f-4b07-ad06-8ac8b5b3c660-kube-api-access-dh7m8\") pod \"cert-manager-webhook-6486ffd997-lktnz\" (UID: \"0ff234fa-928f-4b07-ad06-8ac8b5b3c660\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.557533 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.557359    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ff234fa-928f-4b07-ad06-8ac8b5b3c660-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lktnz\" (UID: \"0ff234fa-928f-4b07-ad06-8ac8b5b3c660\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.613240 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.613205    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"]
Sep 11 21:21:24.615822 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.615803    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.621773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.621748    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:21:24.621773 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:21:24.621731    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.621773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.621751    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:21:24.622029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.621881    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n5pvq\""
Sep 11 21:21:24.642827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.642797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"]
Sep 11 21:21:24.658699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.658670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7m8\" (UniqueName: \"kubernetes.io/projected/0ff234fa-928f-4b07-ad06-8ac8b5b3c660-kube-api-access-dh7m8\") pod \"cert-manager-webhook-6486ffd997-lktnz\" (UID: \"0ff234fa-928f-4b07-ad06-8ac8b5b3c660\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.658840 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.658705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ff234fa-928f-4b07-ad06-8ac8b5b3c660-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lktnz\" (UID: \"0ff234fa-928f-4b07-ad06-8ac8b5b3c660\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.676881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.676847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh7m8\" (UniqueName: \"kubernetes.io/projected/0ff234fa-928f-4b07-ad06-8ac8b5b3c660-kube-api-access-dh7m8\") pod \"cert-manager-webhook-6486ffd997-lktnz\" (UID: \"0ff234fa-928f-4b07-ad06-8ac8b5b3c660\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.677974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.677945    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ff234fa-928f-4b07-ad06-8ac8b5b3c660-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lktnz\" (UID: \"0ff234fa-928f-4b07-ad06-8ac8b5b3c660\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.733702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.733663    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:24.760008 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.759981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vvb\" (UniqueName: \"kubernetes.io/projected/9c8eaaed-ef95-48a9-be3b-5395e94c210f-kube-api-access-d4vvb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.760138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.760033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.760138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.760119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.860723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.860640    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vvb\" (UniqueName: \"kubernetes.io/projected/9c8eaaed-ef95-48a9-be3b-5395e94c210f-kube-api-access-d4vvb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.860723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.860687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.860884 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.860731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.861033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.861019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.861103 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.861085    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.872441 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.872414    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vvb\" (UniqueName: \"kubernetes.io/projected/9c8eaaed-ef95-48a9-be3b-5395e94c210f-kube-api-access-d4vvb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:24.924991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:24.924964    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:25.016209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:25.016180    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lktnz"]
Sep 11 21:21:25.018125 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:21:25.018103    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ff234fa_928f_4b07_ad06_8ac8b5b3c660.slice/crio-bbef279f82aecd8d6129d75a8173db1cc6ba3482688e36693bb5cf1381d6f07a WatchSource:0}: Error finding container bbef279f82aecd8d6129d75a8173db1cc6ba3482688e36693bb5cf1381d6f07a: Status 404 returned error can't find the container with id bbef279f82aecd8d6129d75a8173db1cc6ba3482688e36693bb5cf1381d6f07a
Sep 11 21:21:25.262541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:25.262514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"]
Sep 11 21:21:25.263962 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:21:25.263938    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8eaaed_ef95_48a9_be3b_5395e94c210f.slice/crio-6fd243121b62634b9853b7afc248ab4d411d7b476efa27ab11e4abdd361a11ce WatchSource:0}: Error finding container 6fd243121b62634b9853b7afc248ab4d411d7b476efa27ab11e4abdd361a11ce: Status 404 returned error can't find the container with id 6fd243121b62634b9853b7afc248ab4d411d7b476efa27ab11e4abdd361a11ce
Sep 11 21:21:25.332453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:25.332422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz" event={"ID":"0ff234fa-928f-4b07-ad06-8ac8b5b3c660","Type":"ContainerStarted","Data":"bbef279f82aecd8d6129d75a8173db1cc6ba3482688e36693bb5cf1381d6f07a"}
Sep 11 21:21:25.334241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:25.334217    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj" event={"ID":"9c8eaaed-ef95-48a9-be3b-5395e94c210f","Type":"ContainerStarted","Data":"db9bb345a3e286db4439b3aba0c9c58f52d130569d82f796c9d126634841fec7"}
Sep 11 21:21:25.334389 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:25.334280    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj" event={"ID":"9c8eaaed-ef95-48a9-be3b-5395e94c210f","Type":"ContainerStarted","Data":"6fd243121b62634b9853b7afc248ab4d411d7b476efa27ab11e4abdd361a11ce"}
Sep 11 21:21:26.158565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:26.158522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:26.341518 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:26.341488    2572 generic.go:356] "Generic (PLEG): container finished" podID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerID="db9bb345a3e286db4439b3aba0c9c58f52d130569d82f796c9d126634841fec7" exitCode=0
Sep 11 21:21:26.341673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:26.341556    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj" event={"ID":"9c8eaaed-ef95-48a9-be3b-5395e94c210f","Type":"ContainerDied","Data":"db9bb345a3e286db4439b3aba0c9c58f52d130569d82f796c9d126634841fec7"}
Sep 11 21:21:26.863579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:26.863535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:27.556979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.556956    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"]
Sep 11 21:21:27.559850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.559829    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.563674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.563649    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-m2bfz\""
Sep 11 21:21:27.596469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.596444    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"]
Sep 11 21:21:27.687090 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.687050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e8ed9b4-6fdb-4eed-9985-57003bda24fb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zkgtj\" (UID: \"3e8ed9b4-6fdb-4eed-9985-57003bda24fb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.687246 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.687179    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8pl8\" (UniqueName: \"kubernetes.io/projected/3e8ed9b4-6fdb-4eed-9985-57003bda24fb-kube-api-access-j8pl8\") pod \"cert-manager-cainjector-559cdd8c87-zkgtj\" (UID: \"3e8ed9b4-6fdb-4eed-9985-57003bda24fb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.788012 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.787922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8pl8\" (UniqueName: \"kubernetes.io/projected/3e8ed9b4-6fdb-4eed-9985-57003bda24fb-kube-api-access-j8pl8\") pod \"cert-manager-cainjector-559cdd8c87-zkgtj\" (UID: \"3e8ed9b4-6fdb-4eed-9985-57003bda24fb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.788167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.788081    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e8ed9b4-6fdb-4eed-9985-57003bda24fb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zkgtj\" (UID: \"3e8ed9b4-6fdb-4eed-9985-57003bda24fb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.804635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.804593    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e8ed9b4-6fdb-4eed-9985-57003bda24fb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zkgtj\" (UID: \"3e8ed9b4-6fdb-4eed-9985-57003bda24fb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.804949 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.804925    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8pl8\" (UniqueName: \"kubernetes.io/projected/3e8ed9b4-6fdb-4eed-9985-57003bda24fb-kube-api-access-j8pl8\") pod \"cert-manager-cainjector-559cdd8c87-zkgtj\" (UID: \"3e8ed9b4-6fdb-4eed-9985-57003bda24fb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:27.869775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:27.869732    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"
Sep 11 21:21:28.167474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:28.167421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj"]
Sep 11 21:21:28.170753 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:21:28.170715    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e8ed9b4_6fdb_4eed_9985_57003bda24fb.slice/crio-507b00323d0e9a6dabc42307f630f9a2168f9c3c27a3081cc3c108a34a571ed0 WatchSource:0}: Error finding container 507b00323d0e9a6dabc42307f630f9a2168f9c3c27a3081cc3c108a34a571ed0: Status 404 returned error can't find the container with id 507b00323d0e9a6dabc42307f630f9a2168f9c3c27a3081cc3c108a34a571ed0
Sep 11 21:21:28.354642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:28.354596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz" event={"ID":"0ff234fa-928f-4b07-ad06-8ac8b5b3c660","Type":"ContainerStarted","Data":"cd8b3fb38f2be7ac8fd2142f79731891ffe54bda0506c047d4aedcadda80446f"}
Sep 11 21:21:28.354821 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:28.354663    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:28.355914 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:28.355880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj" event={"ID":"3e8ed9b4-6fdb-4eed-9985-57003bda24fb","Type":"ContainerStarted","Data":"507b00323d0e9a6dabc42307f630f9a2168f9c3c27a3081cc3c108a34a571ed0"}
Sep 11 21:21:28.382358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:28.382304    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz" podStartSLOduration=1.883893931 podStartE2EDuration="4.382287242s" totalImagesPullingTime="2.498393311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:28.380094643 +0000 UTC m=+250.692320009" watchObservedRunningTime="2026-09-11 21:21:28.382287242 +0000 UTC m=+250.694512608"
Sep 11 21:21:29.362170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:29.362137    2572 generic.go:356] "Generic (PLEG): container finished" podID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerID="d4c3920dc6c052e08e4e9e098e1f66b93b4d913d49805a737b18c5123737e3d0" exitCode=0
Sep 11 21:21:29.362579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:29.362221    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj" event={"ID":"9c8eaaed-ef95-48a9-be3b-5395e94c210f","Type":"ContainerDied","Data":"d4c3920dc6c052e08e4e9e098e1f66b93b4d913d49805a737b18c5123737e3d0"}
Sep 11 21:21:29.363807 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:29.363789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj" event={"ID":"3e8ed9b4-6fdb-4eed-9985-57003bda24fb","Type":"ContainerStarted","Data":"654252ce2016d84dd985b8075d8bc842d8ae223c202e7ccf7c32365757075f2a"}
Sep 11 21:21:29.418164 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:29.418119    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zkgtj" podStartSLOduration=2.41810285 podStartE2EDuration="2.41810285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:29.41659807 +0000 UTC m=+251.728823436" watchObservedRunningTime="2026-09-11 21:21:29.41810285 +0000 UTC m=+251.730328216"
Sep 11 21:21:30.369844 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:30.369811    2572 generic.go:356] "Generic (PLEG): container finished" podID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerID="94d3051d263489823230290d21ae09dd12656ed9343f3b98dca212de46ad55b6" exitCode=0
Sep 11 21:21:30.370235 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:30.369895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj" event={"ID":"9c8eaaed-ef95-48a9-be3b-5395e94c210f","Type":"ContainerDied","Data":"94d3051d263489823230290d21ae09dd12656ed9343f3b98dca212de46ad55b6"}
Sep 11 21:21:31.506601 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.506578    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:31.622074 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.622037    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-bundle\") pod \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") "
Sep 11 21:21:31.622236 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.622094    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-util\") pod \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") "
Sep 11 21:21:31.622236 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.622168    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4vvb\" (UniqueName: \"kubernetes.io/projected/9c8eaaed-ef95-48a9-be3b-5395e94c210f-kube-api-access-d4vvb\") pod \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\" (UID: \"9c8eaaed-ef95-48a9-be3b-5395e94c210f\") "
Sep 11 21:21:31.622527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.622505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-bundle" (OuterVolumeSpecName: "bundle") pod "9c8eaaed-ef95-48a9-be3b-5395e94c210f" (UID: "9c8eaaed-ef95-48a9-be3b-5395e94c210f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:21:31.624320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.624291    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8eaaed-ef95-48a9-be3b-5395e94c210f-kube-api-access-d4vvb" (OuterVolumeSpecName: "kube-api-access-d4vvb") pod "9c8eaaed-ef95-48a9-be3b-5395e94c210f" (UID: "9c8eaaed-ef95-48a9-be3b-5395e94c210f"). InnerVolumeSpecName "kube-api-access-d4vvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:21:31.626114 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.626092    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-util" (OuterVolumeSpecName: "util") pod "9c8eaaed-ef95-48a9-be3b-5395e94c210f" (UID: "9c8eaaed-ef95-48a9-be3b-5395e94c210f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:21:31.723428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.723389    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:31.723428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.723421    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c8eaaed-ef95-48a9-be3b-5395e94c210f-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:31.723428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:31.723430    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4vvb\" (UniqueName: \"kubernetes.io/projected/9c8eaaed-ef95-48a9-be3b-5395e94c210f-kube-api-access-d4vvb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:32.384377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:32.384348    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj"
Sep 11 21:21:32.384530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:32.384377    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fltjgj" event={"ID":"9c8eaaed-ef95-48a9-be3b-5395e94c210f","Type":"ContainerDied","Data":"6fd243121b62634b9853b7afc248ab4d411d7b476efa27ab11e4abdd361a11ce"}
Sep 11 21:21:32.384530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:32.384419    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fd243121b62634b9853b7afc248ab4d411d7b476efa27ab11e4abdd361a11ce"
Sep 11 21:21:34.366352 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:34.366316    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lktnz"
Sep 11 21:21:34.535310 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:34.535276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:36.264269 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:36.264225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:36.556531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:36.556447    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:49.396773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:49.396685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:49.497230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:49.497196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:52.297642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:52.297608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:52.407856 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:52.407818    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:53.047975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.047937    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"]
Sep 11 21:21:53.048348 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048333    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="pull"
Sep 11 21:21:53.048402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048350    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="pull"
Sep 11 21:21:53.048402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048370    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="extract"
Sep 11 21:21:53.048402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048377    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="extract"
Sep 11 21:21:53.048402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048392    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="util"
Sep 11 21:21:53.048402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048398    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="util"
Sep 11 21:21:53.048556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.048460    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8eaaed-ef95-48a9-be3b-5395e94c210f" containerName="extract"
Sep 11 21:21:53.050716 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.050695    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.053552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.053527    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:21:53.053552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.053538    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:21:53.053552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.053527    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n5pvq\""
Sep 11 21:21:53.066196 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.066176    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"]
Sep 11 21:21:53.112190 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.112165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.112355 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.112203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.112355 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.112244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl79w\" (UniqueName: \"kubernetes.io/projected/0dd0264a-262d-4a26-bde8-bd6170a78210-kube-api-access-hl79w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.213196 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.213154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.213381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.213208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl79w\" (UniqueName: \"kubernetes.io/projected/0dd0264a-262d-4a26-bde8-bd6170a78210-kube-api-access-hl79w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.213381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.213291    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.213582 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.213564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.213626 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.213584    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.223035 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.223002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl79w\" (UniqueName: \"kubernetes.io/projected/0dd0264a-262d-4a26-bde8-bd6170a78210-kube-api-access-hl79w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.360673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.360584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:53.633881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:53.633801    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"]
Sep 11 21:21:53.637531 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:21:53.637500    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd0264a_262d_4a26_bde8_bd6170a78210.slice/crio-91c316a74aa0abe01efcbf3438ca6ac6fda9d4975ccb808a674d8f348490c053 WatchSource:0}: Error finding container 91c316a74aa0abe01efcbf3438ca6ac6fda9d4975ccb808a674d8f348490c053: Status 404 returned error can't find the container with id 91c316a74aa0abe01efcbf3438ca6ac6fda9d4975ccb808a674d8f348490c053
Sep 11 21:21:54.036570 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:54.036538    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:54.491873 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:54.491781    2572 generic.go:356] "Generic (PLEG): container finished" podID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerID="ca89bca941c0fde43e0865bb1a4fedf032daf0d11c779d4d6e1796ce685e3484" exitCode=0
Sep 11 21:21:54.492279 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:54.491869    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h" event={"ID":"0dd0264a-262d-4a26-bde8-bd6170a78210","Type":"ContainerDied","Data":"ca89bca941c0fde43e0865bb1a4fedf032daf0d11c779d4d6e1796ce685e3484"}
Sep 11 21:21:54.492279 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:54.491931    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h" event={"ID":"0dd0264a-262d-4a26-bde8-bd6170a78210","Type":"ContainerStarted","Data":"91c316a74aa0abe01efcbf3438ca6ac6fda9d4975ccb808a674d8f348490c053"}
Sep 11 21:21:55.499093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:55.499055    2572 generic.go:356] "Generic (PLEG): container finished" podID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerID="ace760f9bae7ba2329e50d6b43c6c3d9fd6711e89812fbfd9e5577b7f94a5787" exitCode=0
Sep 11 21:21:55.499558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:55.499145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h" event={"ID":"0dd0264a-262d-4a26-bde8-bd6170a78210","Type":"ContainerDied","Data":"ace760f9bae7ba2329e50d6b43c6c3d9fd6711e89812fbfd9e5577b7f94a5787"}
Sep 11 21:21:56.085987 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:56.085949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:56.506326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:56.506295    2572 generic.go:356] "Generic (PLEG): container finished" podID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerID="d994a663a41cc46f7be232b1578648cf30175180ae42a19ee739eca3fbef961b" exitCode=0
Sep 11 21:21:56.506698 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:56.506383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h" event={"ID":"0dd0264a-262d-4a26-bde8-bd6170a78210","Type":"ContainerDied","Data":"d994a663a41cc46f7be232b1578648cf30175180ae42a19ee739eca3fbef961b"}
Sep 11 21:21:57.635747 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.635724    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:57.753423 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.753390    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-bundle\") pod \"0dd0264a-262d-4a26-bde8-bd6170a78210\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") "
Sep 11 21:21:57.753581 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.753495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-util\") pod \"0dd0264a-262d-4a26-bde8-bd6170a78210\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") "
Sep 11 21:21:57.753581 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.753529    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl79w\" (UniqueName: \"kubernetes.io/projected/0dd0264a-262d-4a26-bde8-bd6170a78210-kube-api-access-hl79w\") pod \"0dd0264a-262d-4a26-bde8-bd6170a78210\" (UID: \"0dd0264a-262d-4a26-bde8-bd6170a78210\") "
Sep 11 21:21:57.754137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.754097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-bundle" (OuterVolumeSpecName: "bundle") pod "0dd0264a-262d-4a26-bde8-bd6170a78210" (UID: "0dd0264a-262d-4a26-bde8-bd6170a78210"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:21:57.755653 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.755627    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd0264a-262d-4a26-bde8-bd6170a78210-kube-api-access-hl79w" (OuterVolumeSpecName: "kube-api-access-hl79w") pod "0dd0264a-262d-4a26-bde8-bd6170a78210" (UID: "0dd0264a-262d-4a26-bde8-bd6170a78210"). InnerVolumeSpecName "kube-api-access-hl79w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:21:57.759158 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.759125    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-util" (OuterVolumeSpecName: "util") pod "0dd0264a-262d-4a26-bde8-bd6170a78210" (UID: "0dd0264a-262d-4a26-bde8-bd6170a78210"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:21:57.854970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.854887    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:57.854970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.854918    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd0264a-262d-4a26-bde8-bd6170a78210-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:57.854970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:57.854927    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl79w\" (UniqueName: \"kubernetes.io/projected/0dd0264a-262d-4a26-bde8-bd6170a78210-kube-api-access-hl79w\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:21:58.517565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:58.517529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h" event={"ID":"0dd0264a-262d-4a26-bde8-bd6170a78210","Type":"ContainerDied","Data":"91c316a74aa0abe01efcbf3438ca6ac6fda9d4975ccb808a674d8f348490c053"}
Sep 11 21:21:58.517565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:58.517560    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrjk9h"
Sep 11 21:21:58.517765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:21:58.517587    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91c316a74aa0abe01efcbf3438ca6ac6fda9d4975ccb808a674d8f348490c053"
Sep 11 21:22:02.316233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.316196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:02.367188 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367156    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"]
Sep 11 21:22:02.367603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367585    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="extract"
Sep 11 21:22:02.367670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367606    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="extract"
Sep 11 21:22:02.367670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367617    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="pull"
Sep 11 21:22:02.367670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367623    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="pull"
Sep 11 21:22:02.367670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="util"
Sep 11 21:22:02.367670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367638    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="util"
Sep 11 21:22:02.367810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.367702    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd0264a-262d-4a26-bde8-bd6170a78210" containerName="extract"
Sep 11 21:22:02.369894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.369879    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.374552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.374525    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5lxsd\""
Sep 11 21:22:02.374552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.374541    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 21:22:02.374693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.374537    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:22:02.374693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.374576    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 21:22:02.374693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.374534    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 21:22:02.375317 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.375298    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 21:22:02.379733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.379715    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"]
Sep 11 21:22:02.398763 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.398735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:02.493682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.493647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9c80069-7793-44fb-aad9-0c14806051fe-manager-config\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.493682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.493682    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g4nk\" (UniqueName: \"kubernetes.io/projected/d9c80069-7793-44fb-aad9-0c14806051fe-kube-api-access-7g4nk\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.493902 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.493753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9c80069-7793-44fb-aad9-0c14806051fe-metrics-cert\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.493902 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.493772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9c80069-7793-44fb-aad9-0c14806051fe-cert\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.595161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.595077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9c80069-7793-44fb-aad9-0c14806051fe-metrics-cert\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.595161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.595116    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9c80069-7793-44fb-aad9-0c14806051fe-cert\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.595386 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.595168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9c80069-7793-44fb-aad9-0c14806051fe-manager-config\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.595386 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.595195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g4nk\" (UniqueName: \"kubernetes.io/projected/d9c80069-7793-44fb-aad9-0c14806051fe-kube-api-access-7g4nk\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.595907 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.595882    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d9c80069-7793-44fb-aad9-0c14806051fe-manager-config\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.597638 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.597613    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9c80069-7793-44fb-aad9-0c14806051fe-metrics-cert\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.597724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.597676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9c80069-7793-44fb-aad9-0c14806051fe-cert\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.604289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.604243    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g4nk\" (UniqueName: \"kubernetes.io/projected/d9c80069-7793-44fb-aad9-0c14806051fe-kube-api-access-7g4nk\") pod \"lws-controller-manager-77b49fdcf4-grjpw\" (UID: \"d9c80069-7793-44fb-aad9-0c14806051fe\") " pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.680273 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.680225    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:02.954833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:02.954807    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"]
Sep 11 21:22:02.956861 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:22:02.956831    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c80069_7793_44fb_aad9_0c14806051fe.slice/crio-444386ec6462edafd94d3b3a1e36aae27dda085578a358f2b936560023fcf2ac WatchSource:0}: Error finding container 444386ec6462edafd94d3b3a1e36aae27dda085578a358f2b936560023fcf2ac: Status 404 returned error can't find the container with id 444386ec6462edafd94d3b3a1e36aae27dda085578a358f2b936560023fcf2ac
Sep 11 21:22:03.543903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:03.543869    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw" event={"ID":"d9c80069-7793-44fb-aad9-0c14806051fe","Type":"ContainerStarted","Data":"444386ec6462edafd94d3b3a1e36aae27dda085578a358f2b936560023fcf2ac"}
Sep 11 21:22:05.555902 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:05.555859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw" event={"ID":"d9c80069-7793-44fb-aad9-0c14806051fe","Type":"ContainerStarted","Data":"467ff54578d355327547a58f5173e5934dd21aa7f9433ddb92317fe141dd8dad"}
Sep 11 21:22:05.556329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:05.556021    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:05.580635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:05.580580    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw" podStartSLOduration=1.292978934 podStartE2EDuration="3.580560864s" totalImagesPullingTime="2.28758193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:05.579188295 +0000 UTC m=+287.891413673" watchObservedRunningTime="2026-09-11 21:22:05.580560864 +0000 UTC m=+287.892786225"
Sep 11 21:22:07.221963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.221928    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"]
Sep 11 21:22:07.224881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.224857    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.227513 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.227493    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:22:07.227699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.227686    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:22:07.228538 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.228521    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n5pvq\""
Sep 11 21:22:07.237495 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.237469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"]
Sep 11 21:22:07.339126 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.339090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg87m\" (UniqueName: \"kubernetes.io/projected/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-kube-api-access-hg87m\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.339326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.339145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.339326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.339200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.440082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.440036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg87m\" (UniqueName: \"kubernetes.io/projected/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-kube-api-access-hg87m\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.440241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.440102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.440241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.440119    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.440528 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.440510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.440567 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.440551    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.459064 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.459033    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg87m\" (UniqueName: \"kubernetes.io/projected/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-kube-api-access-hg87m\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.533863 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.533827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:07.806871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:07.806841    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"]
Sep 11 21:22:07.808343 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:22:07.808314    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1552cb_ef09_4ef4_ab50_f4bc6b82902e.slice/crio-2784d2488e4bcd8e5979302d34bfdbd4f78da2559d6908093b970c1bfb6946c9 WatchSource:0}: Error finding container 2784d2488e4bcd8e5979302d34bfdbd4f78da2559d6908093b970c1bfb6946c9: Status 404 returned error can't find the container with id 2784d2488e4bcd8e5979302d34bfdbd4f78da2559d6908093b970c1bfb6946c9
Sep 11 21:22:08.550671 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:08.550603    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:08.574804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:08.574772    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerID="a2cf8c17957408f4bdb3b49cb1afd353a4f0984a717bcd169aae2d5224cba91e" exitCode=0
Sep 11 21:22:08.574951 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:08.574810    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw" event={"ID":"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e","Type":"ContainerDied","Data":"a2cf8c17957408f4bdb3b49cb1afd353a4f0984a717bcd169aae2d5224cba91e"}
Sep 11 21:22:08.574951 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:08.574852    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw" event={"ID":"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e","Type":"ContainerStarted","Data":"2784d2488e4bcd8e5979302d34bfdbd4f78da2559d6908093b970c1bfb6946c9"}
Sep 11 21:22:08.661269 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:08.661230    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.214720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.214680    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.535082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.535035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.581872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.581842    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerID="0ff21a2a50f063c41438f897a485a54172b1194dc0e3e1fe0ed8002e5980e791" exitCode=0
Sep 11 21:22:09.582215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.581923    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw" event={"ID":"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e","Type":"ContainerDied","Data":"0ff21a2a50f063c41438f897a485a54172b1194dc0e3e1fe0ed8002e5980e791"}
Sep 11 21:22:09.609398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.609370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.728460 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.728422    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"]
Sep 11 21:22:09.731354 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.731323    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.734277 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.734231    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 21:22:09.734408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.734284    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l4wkn\""
Sep 11 21:22:09.734735 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.734717    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 21:22:09.734830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.734744    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 21:22:09.735136 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.735057    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 21:22:09.790968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.790905    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"]
Sep 11 21:22:09.865561 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.865530    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh6fz\" (UniqueName: \"kubernetes.io/projected/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-kube-api-access-hh6fz\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.865759 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.865580    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.865759 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.865700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.865759 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.865755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-manifests\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.865891 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.865813    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-tmp\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.921868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.921838    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.967006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.966976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh6fz\" (UniqueName: \"kubernetes.io/projected/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-kube-api-access-hh6fz\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.967169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.967025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.967169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.967088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.967169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.967124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-manifests\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.967169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.967154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-tmp\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.967615 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.967587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-manifests\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.969415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.969386    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-tmp\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.969545 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.969525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.969601 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.969583    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:09.980529 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:09.980499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh6fz\" (UniqueName: \"kubernetes.io/projected/bbc67a51-9d3b-4f29-badd-a9b6f6c259f9-kube-api-access-hh6fz\") pod \"opendatahub-operator-controller-manager-68b6c4779-bjkrh\" (UID: \"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9\") " pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:10.022272 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.022204    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:10.098963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.098874    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:10.126187 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.126154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:10.221052 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.221015    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:10.324576 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.324540    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:10.376238 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.376213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"]
Sep 11 21:22:10.378077 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:22:10.378051    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc67a51_9d3b_4f29_badd_a9b6f6c259f9.slice/crio-ae2ab174b5722f8839b62282ded0b1d8a5ded49e05cdd55776e24e3fff3fe6d8 WatchSource:0}: Error finding container ae2ab174b5722f8839b62282ded0b1d8a5ded49e05cdd55776e24e3fff3fe6d8: Status 404 returned error can't find the container with id ae2ab174b5722f8839b62282ded0b1d8a5ded49e05cdd55776e24e3fff3fe6d8
Sep 11 21:22:10.590270 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.590223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh" event={"ID":"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9","Type":"ContainerStarted","Data":"ae2ab174b5722f8839b62282ded0b1d8a5ded49e05cdd55776e24e3fff3fe6d8"}
Sep 11 21:22:10.592246 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.592221    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerID="619694ec8af46711cf472c0a6302cb8997d9c3c7af2ed0954a24a5d1496428d1" exitCode=0
Sep 11 21:22:10.592344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:10.592282    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw" event={"ID":"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e","Type":"ContainerDied","Data":"619694ec8af46711cf472c0a6302cb8997d9c3c7af2ed0954a24a5d1496428d1"}
Sep 11 21:22:13.240419 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.240389    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:13.401701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.401662    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg87m\" (UniqueName: \"kubernetes.io/projected/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-kube-api-access-hg87m\") pod \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") "
Sep 11 21:22:13.401840 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.401780    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-util\") pod \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") "
Sep 11 21:22:13.401840 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.401802    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-bundle\") pod \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\" (UID: \"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e\") "
Sep 11 21:22:13.402598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.402575    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-bundle" (OuterVolumeSpecName: "bundle") pod "ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" (UID: "ad1552cb-ef09-4ef4-ab50-f4bc6b82902e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:13.403790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.403768    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-kube-api-access-hg87m" (OuterVolumeSpecName: "kube-api-access-hg87m") pod "ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" (UID: "ad1552cb-ef09-4ef4-ab50-f4bc6b82902e"). InnerVolumeSpecName "kube-api-access-hg87m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:13.405762 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.405737    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-util" (OuterVolumeSpecName: "util") pod "ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" (UID: "ad1552cb-ef09-4ef4-ab50-f4bc6b82902e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:22:13.502956 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.502916    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:22:13.502956 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.502957    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:22:13.502956 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.502967    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg87m\" (UniqueName: \"kubernetes.io/projected/ad1552cb-ef09-4ef4-ab50-f4bc6b82902e-kube-api-access-hg87m\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:22:13.610694 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.610640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw" event={"ID":"ad1552cb-ef09-4ef4-ab50-f4bc6b82902e","Type":"ContainerDied","Data":"2784d2488e4bcd8e5979302d34bfdbd4f78da2559d6908093b970c1bfb6946c9"}
Sep 11 21:22:13.610858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.610721    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2784d2488e4bcd8e5979302d34bfdbd4f78da2559d6908093b970c1bfb6946c9"
Sep 11 21:22:13.610858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.610660    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0lfbzw"
Sep 11 21:22:13.612475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:13.612439    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh" event={"ID":"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9","Type":"ContainerStarted","Data":"bd88c9ee7c8aede78b14e77f9580cd21fff51ca28805725e4b29af7bd185ea41"}
Sep 11 21:22:14.618795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:14.618758    2572 generic.go:356] "Generic (PLEG): container finished" podID="bbc67a51-9d3b-4f29-badd-a9b6f6c259f9" containerID="bd88c9ee7c8aede78b14e77f9580cd21fff51ca28805725e4b29af7bd185ea41" exitCode=0
Sep 11 21:22:14.619226 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:14.618850    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh" event={"ID":"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9","Type":"ContainerDied","Data":"bd88c9ee7c8aede78b14e77f9580cd21fff51ca28805725e4b29af7bd185ea41"}
Sep 11 21:22:15.576068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:15.576029    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:15.626339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:15.626302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh" event={"ID":"bbc67a51-9d3b-4f29-badd-a9b6f6c259f9","Type":"ContainerStarted","Data":"6e03f21adb78a526a71b7af937c31244af7cbc3df4721e3ac0048e65f50fb7f3"}
Sep 11 21:22:15.626676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:15.626437    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:15.662297 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:15.662225    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh" podStartSLOduration=2.376324962 podStartE2EDuration="6.66220812s" totalImagesPullingTime="3.212000866s" totalInitContainerRuntime="1.073882292s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:15.660551165 +0000 UTC m=+297.972776556" watchObservedRunningTime="2026-09-11 21:22:15.66220812 +0000 UTC m=+297.974433486"
Sep 11 21:22:15.667143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:15.667115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:15.771436 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:15.771397    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:16.563476 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:16.563447    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77b49fdcf4-grjpw"
Sep 11 21:22:16.837983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:16.837892    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:16.941190 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:16.941147    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:18.059105 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:18.059073    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:22:18.063859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:18.063831    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:22:18.070150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:18.070127    2572 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 21:22:26.633530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:26.633495    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68b6c4779-bjkrh"
Sep 11 21:22:28.769484 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:28.769433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:30.124707 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:30.124659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:34.655213 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.655174    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:34.717764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.717735    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"]
Sep 11 21:22:34.718115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718101    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="pull"
Sep 11 21:22:34.718161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718117    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="pull"
Sep 11 21:22:34.718161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718129    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="util"
Sep 11 21:22:34.718161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718135    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="util"
Sep 11 21:22:34.718161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718145    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="extract"
Sep 11 21:22:34.718161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718151    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="extract"
Sep 11 21:22:34.718355 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.718223    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1552cb-ef09-4ef4-ab50-f4bc6b82902e" containerName="extract"
Sep 11 21:22:34.720386 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.720362    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.723291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.723263    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 21:22:34.723291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.723276    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 21:22:34.723472 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.723282    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qqhvz\""
Sep 11 21:22:34.724224 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.724207    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 21:22:34.724299 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.724214    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 21:22:34.743973 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.743942    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"]
Sep 11 21:22:34.791066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.791033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tmp\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.791231 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.791070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tls-certs\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.791231 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.791094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qtj8\" (UniqueName: \"kubernetes.io/projected/86a54eda-3b78-40eb-8d84-c63e268f9ea2-kube-api-access-5qtj8\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.892417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.892371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tmp\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.892608 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.892426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tls-certs\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.892608 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.892462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qtj8\" (UniqueName: \"kubernetes.io/projected/86a54eda-3b78-40eb-8d84-c63e268f9ea2-kube-api-access-5qtj8\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.892608 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:22:34.892589    2572 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 21:22:34.892725 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:22:34.892664    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tls-certs podName:86a54eda-3b78-40eb-8d84-c63e268f9ea2 nodeName:}" failed. No retries permitted until 2026-09-11 21:22:35.392646052 +0000 UTC m=+317.704871399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tls-certs") pod "kube-auth-proxy-5564d7bb97-sg8nb" (UID: "86a54eda-3b78-40eb-8d84-c63e268f9ea2") : secret "kube-auth-proxy-tls" not found
Sep 11 21:22:34.894595 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.894577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tmp\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:34.901641 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:34.901613    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qtj8\" (UniqueName: \"kubernetes.io/projected/86a54eda-3b78-40eb-8d84-c63e268f9ea2-kube-api-access-5qtj8\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:35.061966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:35.061921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:35.398273 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:35.398173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tls-certs\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:35.400590 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:35.400570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86a54eda-3b78-40eb-8d84-c63e268f9ea2-tls-certs\") pod \"kube-auth-proxy-5564d7bb97-sg8nb\" (UID: \"86a54eda-3b78-40eb-8d84-c63e268f9ea2\") " pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:35.630371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:35.630333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"
Sep 11 21:22:35.901147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:35.901120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb"]
Sep 11 21:22:35.902903 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:22:35.902871    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a54eda_3b78_40eb_8d84_c63e268f9ea2.slice/crio-4b5ab730a0f3f93b22c9c89e27e62b19d50c0e8496e26b0f77e6f8024c6df0fd WatchSource:0}: Error finding container 4b5ab730a0f3f93b22c9c89e27e62b19d50c0e8496e26b0f77e6f8024c6df0fd: Status 404 returned error can't find the container with id 4b5ab730a0f3f93b22c9c89e27e62b19d50c0e8496e26b0f77e6f8024c6df0fd
Sep 11 21:22:35.904745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:35.904729    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:22:36.032208 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:36.032172    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:36.122932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:36.122897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:36.736160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:36.736124    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb" event={"ID":"86a54eda-3b78-40eb-8d84-c63e268f9ea2","Type":"ContainerStarted","Data":"4b5ab730a0f3f93b22c9c89e27e62b19d50c0e8496e26b0f77e6f8024c6df0fd"}
Sep 11 21:22:37.021917 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:37.021862    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:38.753748 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:38.753711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb" event={"ID":"86a54eda-3b78-40eb-8d84-c63e268f9ea2","Type":"ContainerStarted","Data":"b443a7119b33acc909eeb4c62d706e405fcf7b088edd7f5f705cc08d11e6854d"}
Sep 11 21:22:38.772285 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:38.772221    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5564d7bb97-sg8nb" podStartSLOduration=2.103703153 podStartE2EDuration="4.772206668s" totalImagesPullingTime="2.668503515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:38.769775671 +0000 UTC m=+321.082001036" watchObservedRunningTime="2026-09-11 21:22:38.772206668 +0000 UTC m=+321.084432061"
Sep 11 21:22:40.962479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:40.962428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.064966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.064927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.163764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.163727    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.286795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.286762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.502058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.502020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.597825 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.597732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.765870 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.765832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.894347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:41.894236    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:42.241344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:42.241265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:42.422971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:42.422937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:46.719143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:46.719107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:46.787063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:46.787022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:51.975644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:51.975592    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:52.084259 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:52.084225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:52.380758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:52.380724    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:52.474713 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:52.474674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.262438 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:53.262394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.372342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:53.372308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.513983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:22:53.513902    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.045592 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:40.045553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.145858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:40.145821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.212548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:40.212507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.767833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:40.767796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.825582 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:40.825540    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:42.004919 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:42.004885    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:42.140001 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:42.139962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:46.995872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:46.995835    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"]
Sep 11 21:23:46.998754 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:46.998734    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.001705 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.001681    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:23:47.001836 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.001684    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:23:47.001836 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.001684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n5pvq\""
Sep 11 21:23:47.009217 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.009191    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"]
Sep 11 21:23:47.104909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.104864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.105112 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.104936    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.105112 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.104977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h8zb\" (UniqueName: \"kubernetes.io/projected/1822aa58-73f8-4dce-b002-fcce401fc5cd-kube-api-access-5h8zb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.111398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.111370    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"]
Sep 11 21:23:47.114482 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.114463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.133615 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.133590    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"]
Sep 11 21:23:47.205731 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.205692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.205890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.205737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.205890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.205757    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h8zb\" (UniqueName: \"kubernetes.io/projected/1822aa58-73f8-4dce-b002-fcce401fc5cd-kube-api-access-5h8zb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.205890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.205797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.205890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.205819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.205890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.205836    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99d8p\" (UniqueName: \"kubernetes.io/projected/7f01776a-6c8a-448a-9989-d46169d790e5-kube-api-access-99d8p\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.206157 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.206136    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.206157 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.206147    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.230335 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.230308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h8zb\" (UniqueName: \"kubernetes.io/projected/1822aa58-73f8-4dce-b002-fcce401fc5cd-kube-api-access-5h8zb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.261288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.261247    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"]
Sep 11 21:23:47.264106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.264090    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.279102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.279074    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"]
Sep 11 21:23:47.306920 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.306891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.307067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.306932    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.307067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.306957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99d8p\" (UniqueName: \"kubernetes.io/projected/7f01776a-6c8a-448a-9989-d46169d790e5-kube-api-access-99d8p\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.307410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.307389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.307491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.307426    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.308784 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.308766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:47.319932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.319911    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99d8p\" (UniqueName: \"kubernetes.io/projected/7f01776a-6c8a-448a-9989-d46169d790e5-kube-api-access-99d8p\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.389643 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.389606    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"]
Sep 11 21:23:47.393473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.393452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.407801 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.407771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.407908 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.407814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpql4\" (UniqueName: \"kubernetes.io/projected/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-kube-api-access-kpql4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.407908 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.407878    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.412933 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.412905    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"]
Sep 11 21:23:47.423680 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.423655    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:47.508655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.508616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.508808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.508665    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnq5\" (UniqueName: \"kubernetes.io/projected/0d72194f-5a8d-4251-be97-8e0d1e0738b4-kube-api-access-2qnq5\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.508808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.508690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpql4\" (UniqueName: \"kubernetes.io/projected/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-kube-api-access-kpql4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.508808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.508741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.508808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.508757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.508808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.508784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.509198 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.509174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.509278 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.509177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.517680 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.517631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpql4\" (UniqueName: \"kubernetes.io/projected/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-kube-api-access-kpql4\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.573610 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.573578    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:47.580449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.580428    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"]
Sep 11 21:23:47.583533 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:23:47.583509    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1822aa58_73f8_4dce_b002_fcce401fc5cd.slice/crio-628a21f4fc9c682d097f023f5e77674591c6388d728560cda698636dc3c588a9 WatchSource:0}: Error finding container 628a21f4fc9c682d097f023f5e77674591c6388d728560cda698636dc3c588a9: Status 404 returned error can't find the container with id 628a21f4fc9c682d097f023f5e77674591c6388d728560cda698636dc3c588a9
Sep 11 21:23:47.609664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.609633    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.609753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.609675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.609806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.609755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnq5\" (UniqueName: \"kubernetes.io/projected/0d72194f-5a8d-4251-be97-8e0d1e0738b4-kube-api-access-2qnq5\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.610000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.609982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.610122 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.610102    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.618860 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.618833    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnq5\" (UniqueName: \"kubernetes.io/projected/0d72194f-5a8d-4251-be97-8e0d1e0738b4-kube-api-access-2qnq5\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.698952 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.698922    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"]
Sep 11 21:23:47.700359 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:23:47.700334    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f01776a_6c8a_448a_9989_d46169d790e5.slice/crio-cbfb94b95f669d956cc937708fe34998f7ef98500723834803fdb03378cbe8ec WatchSource:0}: Error finding container cbfb94b95f669d956cc937708fe34998f7ef98500723834803fdb03378cbe8ec: Status 404 returned error can't find the container with id cbfb94b95f669d956cc937708fe34998f7ef98500723834803fdb03378cbe8ec
Sep 11 21:23:47.702762 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.702743    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:47.852007 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.851985    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"]
Sep 11 21:23:47.887037 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:23:47.887006    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdbd6c6_c8a1_4886_8a1e_a6dedc49b1f8.slice/crio-fdf12975791b5311845efa76701465e60ce9f079ba1d0ae8739ff47de6af4346 WatchSource:0}: Error finding container fdf12975791b5311845efa76701465e60ce9f079ba1d0ae8739ff47de6af4346: Status 404 returned error can't find the container with id fdf12975791b5311845efa76701465e60ce9f079ba1d0ae8739ff47de6af4346
Sep 11 21:23:47.981727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:47.981696    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"]
Sep 11 21:23:47.983682 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:23:47.983655    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d72194f_5a8d_4251_be97_8e0d1e0738b4.slice/crio-33424cc4261f9f0b5cfacd16afca26bd88875d952a0dcbc5eb5d782612bcfdd8 WatchSource:0}: Error finding container 33424cc4261f9f0b5cfacd16afca26bd88875d952a0dcbc5eb5d782612bcfdd8: Status 404 returned error can't find the container with id 33424cc4261f9f0b5cfacd16afca26bd88875d952a0dcbc5eb5d782612bcfdd8
Sep 11 21:23:48.108322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.108290    2572 generic.go:356] "Generic (PLEG): container finished" podID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerID="3f4a9c8b337af8074cba955436f9445b01e4f320b02ce137fbe1e65d022355b3" exitCode=0
Sep 11 21:23:48.108708 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.108344    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4" event={"ID":"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8","Type":"ContainerDied","Data":"3f4a9c8b337af8074cba955436f9445b01e4f320b02ce137fbe1e65d022355b3"}
Sep 11 21:23:48.108708 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.108394    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4" event={"ID":"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8","Type":"ContainerStarted","Data":"fdf12975791b5311845efa76701465e60ce9f079ba1d0ae8739ff47de6af4346"}
Sep 11 21:23:48.109940 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.109919    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f01776a-6c8a-448a-9989-d46169d790e5" containerID="e4dda1954d34bb4e9a6457b703b9e0e22ca4027a1aaa3520084dbb4e76843865" exitCode=0
Sep 11 21:23:48.110023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.110000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg" event={"ID":"7f01776a-6c8a-448a-9989-d46169d790e5","Type":"ContainerDied","Data":"e4dda1954d34bb4e9a6457b703b9e0e22ca4027a1aaa3520084dbb4e76843865"}
Sep 11 21:23:48.110099 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.110049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg" event={"ID":"7f01776a-6c8a-448a-9989-d46169d790e5","Type":"ContainerStarted","Data":"cbfb94b95f669d956cc937708fe34998f7ef98500723834803fdb03378cbe8ec"}
Sep 11 21:23:48.111690 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.111668    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerID="8316a7d3c406a00f410ea547a9c33cfcfce8ca305830efbbd44d552c6b2d58c4" exitCode=0
Sep 11 21:23:48.111794 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.111759    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt" event={"ID":"0d72194f-5a8d-4251-be97-8e0d1e0738b4","Type":"ContainerDied","Data":"8316a7d3c406a00f410ea547a9c33cfcfce8ca305830efbbd44d552c6b2d58c4"}
Sep 11 21:23:48.111852 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.111794    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt" event={"ID":"0d72194f-5a8d-4251-be97-8e0d1e0738b4","Type":"ContainerStarted","Data":"33424cc4261f9f0b5cfacd16afca26bd88875d952a0dcbc5eb5d782612bcfdd8"}
Sep 11 21:23:48.113697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.113676    2572 generic.go:356] "Generic (PLEG): container finished" podID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerID="2a62ae78d02dee6ddd9c2b34e1e6106349441f705aee7d2c3937582cc7824efc" exitCode=0
Sep 11 21:23:48.113786 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.113705    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt" event={"ID":"1822aa58-73f8-4dce-b002-fcce401fc5cd","Type":"ContainerDied","Data":"2a62ae78d02dee6ddd9c2b34e1e6106349441f705aee7d2c3937582cc7824efc"}
Sep 11 21:23:48.113786 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:48.113752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt" event={"ID":"1822aa58-73f8-4dce-b002-fcce401fc5cd","Type":"ContainerStarted","Data":"628a21f4fc9c682d097f023f5e77674591c6388d728560cda698636dc3c588a9"}
Sep 11 21:23:49.120728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:49.120695    2572 generic.go:356] "Generic (PLEG): container finished" podID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerID="7f81177da6b948e49d8de8d54ea07922804da6484b9f01152885d62b5107eb98" exitCode=0
Sep 11 21:23:49.121068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:49.120773    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt" event={"ID":"1822aa58-73f8-4dce-b002-fcce401fc5cd","Type":"ContainerDied","Data":"7f81177da6b948e49d8de8d54ea07922804da6484b9f01152885d62b5107eb98"}
Sep 11 21:23:50.128583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.128544    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f01776a-6c8a-448a-9989-d46169d790e5" containerID="492c9bf6cd8575c26c4eb71d894dd49cf7864856cbe55fcd46ccb7010157616f" exitCode=0
Sep 11 21:23:50.129004 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.128629    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg" event={"ID":"7f01776a-6c8a-448a-9989-d46169d790e5","Type":"ContainerDied","Data":"492c9bf6cd8575c26c4eb71d894dd49cf7864856cbe55fcd46ccb7010157616f"}
Sep 11 21:23:50.130555 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.130533    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerID="0a32e72513c727751aa0a1b947d2bdbf2cb8f5c93e9fffefb26e16d2d2613fc7" exitCode=0
Sep 11 21:23:50.130656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.130617    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt" event={"ID":"0d72194f-5a8d-4251-be97-8e0d1e0738b4","Type":"ContainerDied","Data":"0a32e72513c727751aa0a1b947d2bdbf2cb8f5c93e9fffefb26e16d2d2613fc7"}
Sep 11 21:23:50.132985 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.132966    2572 generic.go:356] "Generic (PLEG): container finished" podID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerID="a818c535bddc1a8ef55c5fa4a4815e2e0e91c4c2bd773564c01fcac18c2aa751" exitCode=0
Sep 11 21:23:50.133106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.133044    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt" event={"ID":"1822aa58-73f8-4dce-b002-fcce401fc5cd","Type":"ContainerDied","Data":"a818c535bddc1a8ef55c5fa4a4815e2e0e91c4c2bd773564c01fcac18c2aa751"}
Sep 11 21:23:50.135056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.135034    2572 generic.go:356] "Generic (PLEG): container finished" podID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerID="83bbb7f7f42ac4566c62ca81fee2ec285a942123650198559f50d02c266ab02a" exitCode=0
Sep 11 21:23:50.135137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.135075    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4" event={"ID":"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8","Type":"ContainerDied","Data":"83bbb7f7f42ac4566c62ca81fee2ec285a942123650198559f50d02c266ab02a"}
Sep 11 21:23:50.806581 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.806541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:50.877740 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.877702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:50.945428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:50.945391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:51.142121 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.142043    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerID="b5560966054d7905a13beb5cb944a8810ec45d196d0cd0dda5cfa5b05b539a66" exitCode=0
Sep 11 21:23:51.142519 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.142119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt" event={"ID":"0d72194f-5a8d-4251-be97-8e0d1e0738b4","Type":"ContainerDied","Data":"b5560966054d7905a13beb5cb944a8810ec45d196d0cd0dda5cfa5b05b539a66"}
Sep 11 21:23:51.144225 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.144203    2572 generic.go:356] "Generic (PLEG): container finished" podID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerID="a1944760ef8af2eeccac53fb39422bbdb96ebffa3455178790cfa9db6fb75b68" exitCode=0
Sep 11 21:23:51.144371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.144290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4" event={"ID":"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8","Type":"ContainerDied","Data":"a1944760ef8af2eeccac53fb39422bbdb96ebffa3455178790cfa9db6fb75b68"}
Sep 11 21:23:51.146366 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.146336    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f01776a-6c8a-448a-9989-d46169d790e5" containerID="63cf495d12c18cbb88d437476ff09afaef363122c41d55dff000391fecbb2588" exitCode=0
Sep 11 21:23:51.146460 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.146419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg" event={"ID":"7f01776a-6c8a-448a-9989-d46169d790e5","Type":"ContainerDied","Data":"63cf495d12c18cbb88d437476ff09afaef363122c41d55dff000391fecbb2588"}
Sep 11 21:23:51.278443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.278418    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:51.342923 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.342889    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-bundle\") pod \"1822aa58-73f8-4dce-b002-fcce401fc5cd\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") "
Sep 11 21:23:51.343087 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.342942    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-util\") pod \"1822aa58-73f8-4dce-b002-fcce401fc5cd\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") "
Sep 11 21:23:51.343087 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.342983    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h8zb\" (UniqueName: \"kubernetes.io/projected/1822aa58-73f8-4dce-b002-fcce401fc5cd-kube-api-access-5h8zb\") pod \"1822aa58-73f8-4dce-b002-fcce401fc5cd\" (UID: \"1822aa58-73f8-4dce-b002-fcce401fc5cd\") "
Sep 11 21:23:51.343668 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.343641    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-bundle" (OuterVolumeSpecName: "bundle") pod "1822aa58-73f8-4dce-b002-fcce401fc5cd" (UID: "1822aa58-73f8-4dce-b002-fcce401fc5cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:51.345109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.345083    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1822aa58-73f8-4dce-b002-fcce401fc5cd-kube-api-access-5h8zb" (OuterVolumeSpecName: "kube-api-access-5h8zb") pod "1822aa58-73f8-4dce-b002-fcce401fc5cd" (UID: "1822aa58-73f8-4dce-b002-fcce401fc5cd"). InnerVolumeSpecName "kube-api-access-5h8zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:51.348404 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.348382    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-util" (OuterVolumeSpecName: "util") pod "1822aa58-73f8-4dce-b002-fcce401fc5cd" (UID: "1822aa58-73f8-4dce-b002-fcce401fc5cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:51.443871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.443789    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:51.443871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.443815    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1822aa58-73f8-4dce-b002-fcce401fc5cd-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:51.443871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:51.443825    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h8zb\" (UniqueName: \"kubernetes.io/projected/1822aa58-73f8-4dce-b002-fcce401fc5cd-kube-api-access-5h8zb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.153529 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.153501    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt"
Sep 11 21:23:52.153900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.153524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afhwnt" event={"ID":"1822aa58-73f8-4dce-b002-fcce401fc5cd","Type":"ContainerDied","Data":"628a21f4fc9c682d097f023f5e77674591c6388d728560cda698636dc3c588a9"}
Sep 11 21:23:52.153900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.153566    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="628a21f4fc9c682d097f023f5e77674591c6388d728560cda698636dc3c588a9"
Sep 11 21:23:52.322545 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.322521    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:52.324722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.324703    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:52.352673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.352649    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:52.454138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454052    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-util\") pod \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") "
Sep 11 21:23:52.454138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454110    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-util\") pod \"7f01776a-6c8a-448a-9989-d46169d790e5\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") "
Sep 11 21:23:52.454138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454134    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-bundle\") pod \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454174    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99d8p\" (UniqueName: \"kubernetes.io/projected/7f01776a-6c8a-448a-9989-d46169d790e5-kube-api-access-99d8p\") pod \"7f01776a-6c8a-448a-9989-d46169d790e5\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454216    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpql4\" (UniqueName: \"kubernetes.io/projected/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-kube-api-access-kpql4\") pod \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454242    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-bundle\") pod \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454305    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qnq5\" (UniqueName: \"kubernetes.io/projected/0d72194f-5a8d-4251-be97-8e0d1e0738b4-kube-api-access-2qnq5\") pod \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\" (UID: \"0d72194f-5a8d-4251-be97-8e0d1e0738b4\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-bundle\") pod \"7f01776a-6c8a-448a-9989-d46169d790e5\" (UID: \"7f01776a-6c8a-448a-9989-d46169d790e5\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454377    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-util\") pod \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\" (UID: \"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8\") "
Sep 11 21:23:52.454842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454676    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-bundle" (OuterVolumeSpecName: "bundle") pod "0d72194f-5a8d-4251-be97-8e0d1e0738b4" (UID: "0d72194f-5a8d-4251-be97-8e0d1e0738b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:52.455178 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.454765    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-bundle" (OuterVolumeSpecName: "bundle") pod "9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" (UID: "9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:52.455395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.455365    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-bundle" (OuterVolumeSpecName: "bundle") pod "7f01776a-6c8a-448a-9989-d46169d790e5" (UID: "7f01776a-6c8a-448a-9989-d46169d790e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:52.456732 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.456695    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f01776a-6c8a-448a-9989-d46169d790e5-kube-api-access-99d8p" (OuterVolumeSpecName: "kube-api-access-99d8p") pod "7f01776a-6c8a-448a-9989-d46169d790e5" (UID: "7f01776a-6c8a-448a-9989-d46169d790e5"). InnerVolumeSpecName "kube-api-access-99d8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:52.456832 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.456746    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-kube-api-access-kpql4" (OuterVolumeSpecName: "kube-api-access-kpql4") pod "9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" (UID: "9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8"). InnerVolumeSpecName "kube-api-access-kpql4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:52.457300 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.457276    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d72194f-5a8d-4251-be97-8e0d1e0738b4-kube-api-access-2qnq5" (OuterVolumeSpecName: "kube-api-access-2qnq5") pod "0d72194f-5a8d-4251-be97-8e0d1e0738b4" (UID: "0d72194f-5a8d-4251-be97-8e0d1e0738b4"). InnerVolumeSpecName "kube-api-access-2qnq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:52.460445 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.460420    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-util" (OuterVolumeSpecName: "util") pod "7f01776a-6c8a-448a-9989-d46169d790e5" (UID: "7f01776a-6c8a-448a-9989-d46169d790e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:52.460703 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.460682    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-util" (OuterVolumeSpecName: "util") pod "0d72194f-5a8d-4251-be97-8e0d1e0738b4" (UID: "0d72194f-5a8d-4251-be97-8e0d1e0738b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:52.461424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.461403    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-util" (OuterVolumeSpecName: "util") pod "9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" (UID: "9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:23:52.555241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555206    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555236    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555245    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99d8p\" (UniqueName: \"kubernetes.io/projected/7f01776a-6c8a-448a-9989-d46169d790e5-kube-api-access-99d8p\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555277    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpql4\" (UniqueName: \"kubernetes.io/projected/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-kube-api-access-kpql4\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555288    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555295    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qnq5\" (UniqueName: \"kubernetes.io/projected/0d72194f-5a8d-4251-be97-8e0d1e0738b4-kube-api-access-2qnq5\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555303    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f01776a-6c8a-448a-9989-d46169d790e5-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555311    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:52.555488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:52.555319    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d72194f-5a8d-4251-be97-8e0d1e0738b4-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:23:53.163227 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.163197    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4"
Sep 11 21:23:53.163227 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.163208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d77v6l4" event={"ID":"9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8","Type":"ContainerDied","Data":"fdf12975791b5311845efa76701465e60ce9f079ba1d0ae8739ff47de6af4346"}
Sep 11 21:23:53.163707 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.163283    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdf12975791b5311845efa76701465e60ce9f079ba1d0ae8739ff47de6af4346"
Sep 11 21:23:53.165151 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.165131    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg"
Sep 11 21:23:53.165284 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.165180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cn4kkg" event={"ID":"7f01776a-6c8a-448a-9989-d46169d790e5","Type":"ContainerDied","Data":"cbfb94b95f669d956cc937708fe34998f7ef98500723834803fdb03378cbe8ec"}
Sep 11 21:23:53.165284 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.165215    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbfb94b95f669d956cc937708fe34998f7ef98500723834803fdb03378cbe8ec"
Sep 11 21:23:53.167505 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.167486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt" event={"ID":"0d72194f-5a8d-4251-be97-8e0d1e0738b4","Type":"ContainerDied","Data":"33424cc4261f9f0b5cfacd16afca26bd88875d952a0dcbc5eb5d782612bcfdd8"}
Sep 11 21:23:53.167622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.167525    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33424cc4261f9f0b5cfacd16afca26bd88875d952a0dcbc5eb5d782612bcfdd8"
Sep 11 21:23:53.167622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:53.167488    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6cmqwt"
Sep 11 21:23:55.754011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:55.753953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:56.562594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:56.562561    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:59.588051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:59.588018    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:59.831416 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:23:59.831386    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:01.539775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:01.539738    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:01.807203 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:01.807095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:02.169041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:02.168957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:02.571910 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:02.571879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:02.843744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:02.843651    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:02.934931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:02.934900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:05.965557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:05.965523    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:07.431052 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:07.431007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:09.030501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:09.030461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:09.137444 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:09.137413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:09.367631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:09.367544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:09.447607 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:09.447571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:12.972496 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:12.972460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:13.047851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.047810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:13.388478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388444    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"]
Sep 11 21:24:13.388901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388879    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="util"
Sep 11 21:24:13.388901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388900    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="util"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388910    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="extract"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388918    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="extract"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388927    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="extract"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388935    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="extract"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388946    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="util"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388954    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="util"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388962    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="pull"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388970    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="pull"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388979    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="extract"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.388987    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="extract"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389001    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="pull"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389009    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="pull"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389024    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="pull"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389033    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="pull"
Sep 11 21:24:13.389045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389045    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="util"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389054    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="util"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389076    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="util"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389085    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="util"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389097    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="extract"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389105    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="extract"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389116    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="pull"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389124    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="pull"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389221    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1822aa58-73f8-4dce-b002-fcce401fc5cd" containerName="extract"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389238    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bdbd6c6-c8a1-4886-8a1e-a6dedc49b1f8" containerName="extract"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389267    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d72194f-5a8d-4251-be97-8e0d1e0738b4" containerName="extract"
Sep 11 21:24:13.389783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.389278    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f01776a-6c8a-448a-9989-d46169d790e5" containerName="extract"
Sep 11 21:24:13.390512 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.390483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:13.392677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.392659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.396206 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.396183    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 21:24:13.397364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.397348    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jdp7f\""
Sep 11 21:24:13.397460 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.397431    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 21:24:13.398328 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.398307    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 21:24:13.398434 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.398389    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 21:24:13.403141 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.403122    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"]
Sep 11 21:24:13.438405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.438378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/059177a9-7327-49c9-943e-ac4b6548bc13-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.438553 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.438432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwnhx\" (UniqueName: \"kubernetes.io/projected/059177a9-7327-49c9-943e-ac4b6548bc13-kube-api-access-jwnhx\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.438603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.438551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/059177a9-7327-49c9-943e-ac4b6548bc13-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.539021 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.538981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/059177a9-7327-49c9-943e-ac4b6548bc13-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.539209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.539040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/059177a9-7327-49c9-943e-ac4b6548bc13-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.539209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.539069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwnhx\" (UniqueName: \"kubernetes.io/projected/059177a9-7327-49c9-943e-ac4b6548bc13-kube-api-access-jwnhx\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.539209 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:24:13.539134    2572 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 11 21:24:13.539419 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:24:13.539218    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/059177a9-7327-49c9-943e-ac4b6548bc13-plugin-serving-cert podName:059177a9-7327-49c9-943e-ac4b6548bc13 nodeName:}" failed. No retries permitted until 2026-09-11 21:24:14.039197234 +0000 UTC m=+416.351422583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/059177a9-7327-49c9-943e-ac4b6548bc13-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-kvq2b" (UID: "059177a9-7327-49c9-943e-ac4b6548bc13") : secret "plugin-serving-cert" not found
Sep 11 21:24:13.539700 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.539681    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/059177a9-7327-49c9-943e-ac4b6548bc13-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.547665 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.547641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwnhx\" (UniqueName: \"kubernetes.io/projected/059177a9-7327-49c9-943e-ac4b6548bc13-kube-api-access-jwnhx\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:13.849781 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:13.849746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:14.041822 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:14.041782    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/059177a9-7327-49c9-943e-ac4b6548bc13-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:14.044164 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:14.044132    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/059177a9-7327-49c9-943e-ac4b6548bc13-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-kvq2b\" (UID: \"059177a9-7327-49c9-943e-ac4b6548bc13\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:14.302854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:14.302825    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"
Sep 11 21:24:14.591733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:14.589532    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b"]
Sep 11 21:24:14.593969 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:24:14.593926    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod059177a9_7327_49c9_943e_ac4b6548bc13.slice/crio-309e0bebfdfdb98f97a1dd5fcffbe5574df992296c51761f4429837ad3833433 WatchSource:0}: Error finding container 309e0bebfdfdb98f97a1dd5fcffbe5574df992296c51761f4429837ad3833433: Status 404 returned error can't find the container with id 309e0bebfdfdb98f97a1dd5fcffbe5574df992296c51761f4429837ad3833433
Sep 11 21:24:15.287239 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:15.287195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b" event={"ID":"059177a9-7327-49c9-943e-ac4b6548bc13","Type":"ContainerStarted","Data":"309e0bebfdfdb98f97a1dd5fcffbe5574df992296c51761f4429837ad3833433"}
Sep 11 21:24:18.581985 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:18.581951    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:18.674710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:18.674675    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:18.777038 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:18.776945    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:19.313503 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:19.313407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b" event={"ID":"059177a9-7327-49c9-943e-ac4b6548bc13","Type":"ContainerStarted","Data":"0786060508be95c826c31e270d8a181e44bbd4207884344159b43f3b4056f73d"}
Sep 11 21:24:19.335183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:19.335141    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-kvq2b" podStartSLOduration=1.8869797670000001 podStartE2EDuration="6.335124256s" totalImagesPullingTime="4.448144489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:24:19.332490432 +0000 UTC m=+421.644715798" watchObservedRunningTime="2026-09-11 21:24:19.335124256 +0000 UTC m=+421.647349623"
Sep 11 21:24:21.823347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:21.823292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:21.931628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:21.931572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:25.650609 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:25.650571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:25.785919 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:25.785878    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:29.412795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:29.412762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:29.512811 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:29.512775    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:30.011376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:30.011340    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:30.118544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:30.118511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:32.408979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:32.408940    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:32.468482 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:32.468443    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:38.509046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:38.509015    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:38.608097 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:38.608043    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:38.709180 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:38.709148    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:45.495746 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:45.495656    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:45.596185 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:45.596148    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:54.630847 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:54.630809    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:54.738426 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:54.738389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.982887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:56.982850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.994247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:56.994210    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:24:57.013491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.013447    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:24:57.013642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.013546    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.016175 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.016153    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 21:24:57.089111 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.089078    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:24:57.091726 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.091699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:57.110877 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.110840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kk4q\" (UniqueName: \"kubernetes.io/projected/b20676aa-5193-4ce0-9d8e-a34898cc9c23-kube-api-access-5kk4q\") pod \"limitador-limitador-8588749977-stlm9\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") " pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.111026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.110957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20676aa-5193-4ce0-9d8e-a34898cc9c23-config-file\") pod \"limitador-limitador-8588749977-stlm9\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") " pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.194564 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.194531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:57.211628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.211596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20676aa-5193-4ce0-9d8e-a34898cc9c23-config-file\") pod \"limitador-limitador-8588749977-stlm9\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") " pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.211810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.211666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kk4q\" (UniqueName: \"kubernetes.io/projected/b20676aa-5193-4ce0-9d8e-a34898cc9c23-kube-api-access-5kk4q\") pod \"limitador-limitador-8588749977-stlm9\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") " pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.212221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.212203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20676aa-5193-4ce0-9d8e-a34898cc9c23-config-file\") pod \"limitador-limitador-8588749977-stlm9\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") " pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.220842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.220813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kk4q\" (UniqueName: \"kubernetes.io/projected/b20676aa-5193-4ce0-9d8e-a34898cc9c23-kube-api-access-5kk4q\") pod \"limitador-limitador-8588749977-stlm9\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") " pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.325835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.325800    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:24:57.598138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.598114    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:24:57.599906 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:24:57.599877    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20676aa_5193_4ce0_9d8e_a34898cc9c23.slice/crio-9020ead8716183737a309997a580618e627d6296755978eb9982d79294201dc8 WatchSource:0}: Error finding container 9020ead8716183737a309997a580618e627d6296755978eb9982d79294201dc8: Status 404 returned error can't find the container with id 9020ead8716183737a309997a580618e627d6296755978eb9982d79294201dc8
Sep 11 21:24:57.786006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.785973    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kdbdr"]
Sep 11 21:24:57.790881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.790862    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:24:57.793479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.793451    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nz7pm\""
Sep 11 21:24:57.797701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.797675    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kdbdr"]
Sep 11 21:24:57.824827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.824801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:57.909707 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.909616    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:57.920809 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:57.920777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9mfc\" (UniqueName: \"kubernetes.io/projected/8ee8bfec-5227-4831-81dc-6ce4eb23f45f-kube-api-access-w9mfc\") pod \"authorino-7bcfd8f9cd-kdbdr\" (UID: \"8ee8bfec-5227-4831-81dc-6ce4eb23f45f\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:24:58.022077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:58.022036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9mfc\" (UniqueName: \"kubernetes.io/projected/8ee8bfec-5227-4831-81dc-6ce4eb23f45f-kube-api-access-w9mfc\") pod \"authorino-7bcfd8f9cd-kdbdr\" (UID: \"8ee8bfec-5227-4831-81dc-6ce4eb23f45f\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:24:58.032845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:58.032812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9mfc\" (UniqueName: \"kubernetes.io/projected/8ee8bfec-5227-4831-81dc-6ce4eb23f45f-kube-api-access-w9mfc\") pod \"authorino-7bcfd8f9cd-kdbdr\" (UID: \"8ee8bfec-5227-4831-81dc-6ce4eb23f45f\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:24:58.101768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:58.101725    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:24:58.377347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:58.377275    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kdbdr"]
Sep 11 21:24:58.380045 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:24:58.380013    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ee8bfec_5227_4831_81dc_6ce4eb23f45f.slice/crio-3cf824520c9d5c1e52e1555874f0cff86154abe1c5ddf67b12d26ed5c37b50f0 WatchSource:0}: Error finding container 3cf824520c9d5c1e52e1555874f0cff86154abe1c5ddf67b12d26ed5c37b50f0: Status 404 returned error can't find the container with id 3cf824520c9d5c1e52e1555874f0cff86154abe1c5ddf67b12d26ed5c37b50f0
Sep 11 21:24:58.535345 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:58.535310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-stlm9" event={"ID":"b20676aa-5193-4ce0-9d8e-a34898cc9c23","Type":"ContainerStarted","Data":"9020ead8716183737a309997a580618e627d6296755978eb9982d79294201dc8"}
Sep 11 21:24:58.536824 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:24:58.536793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr" event={"ID":"8ee8bfec-5227-4831-81dc-6ce4eb23f45f","Type":"ContainerStarted","Data":"3cf824520c9d5c1e52e1555874f0cff86154abe1c5ddf67b12d26ed5c37b50f0"}
Sep 11 21:25:00.551684 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:00.551648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-stlm9" event={"ID":"b20676aa-5193-4ce0-9d8e-a34898cc9c23","Type":"ContainerStarted","Data":"2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784"}
Sep 11 21:25:00.552151 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:00.551780    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:25:00.588877 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:00.588812    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-stlm9" podStartSLOduration=2.377469413 podStartE2EDuration="4.588790419s" totalImagesPullingTime="2.211321006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:25:00.586990886 +0000 UTC m=+462.899216251" watchObservedRunningTime="2026-09-11 21:25:00.588790419 +0000 UTC m=+462.901015786"
Sep 11 21:25:01.244846 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:01.244763    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kdbdr"]
Sep 11 21:25:01.565426 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:01.565389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr" event={"ID":"8ee8bfec-5227-4831-81dc-6ce4eb23f45f","Type":"ContainerStarted","Data":"3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de"}
Sep 11 21:25:01.582811 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:01.582759    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr" podStartSLOduration=2.213456705 podStartE2EDuration="4.582743293s" totalImagesPullingTime="2.369286588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:25:01.581068096 +0000 UTC m=+463.893293462" watchObservedRunningTime="2026-09-11 21:25:01.582743293 +0000 UTC m=+463.894968659"
Sep 11 21:25:02.571410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:02.571367    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr" podUID="8ee8bfec-5227-4831-81dc-6ce4eb23f45f" containerName="authorino" containerID="cri-o://3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de" gracePeriod=30
Sep 11 21:25:02.817083 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:02.817058    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:25:02.967774 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:02.967690    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9mfc\" (UniqueName: \"kubernetes.io/projected/8ee8bfec-5227-4831-81dc-6ce4eb23f45f-kube-api-access-w9mfc\") pod \"8ee8bfec-5227-4831-81dc-6ce4eb23f45f\" (UID: \"8ee8bfec-5227-4831-81dc-6ce4eb23f45f\") "
Sep 11 21:25:02.969909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:02.969885    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee8bfec-5227-4831-81dc-6ce4eb23f45f-kube-api-access-w9mfc" (OuterVolumeSpecName: "kube-api-access-w9mfc") pod "8ee8bfec-5227-4831-81dc-6ce4eb23f45f" (UID: "8ee8bfec-5227-4831-81dc-6ce4eb23f45f"). InnerVolumeSpecName "kube-api-access-w9mfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:25:03.068870 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.068830    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9mfc\" (UniqueName: \"kubernetes.io/projected/8ee8bfec-5227-4831-81dc-6ce4eb23f45f-kube-api-access-w9mfc\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:25:03.577714 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.577675    2572 generic.go:356] "Generic (PLEG): container finished" podID="8ee8bfec-5227-4831-81dc-6ce4eb23f45f" containerID="3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de" exitCode=0
Sep 11 21:25:03.578134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.577716    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr"
Sep 11 21:25:03.578134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.577767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr" event={"ID":"8ee8bfec-5227-4831-81dc-6ce4eb23f45f","Type":"ContainerDied","Data":"3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de"}
Sep 11 21:25:03.578134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.577805    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kdbdr" event={"ID":"8ee8bfec-5227-4831-81dc-6ce4eb23f45f","Type":"ContainerDied","Data":"3cf824520c9d5c1e52e1555874f0cff86154abe1c5ddf67b12d26ed5c37b50f0"}
Sep 11 21:25:03.578134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.577822    2572 scope.go:117] "RemoveContainer" containerID="3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de"
Sep 11 21:25:03.587469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.587449    2572 scope.go:117] "RemoveContainer" containerID="3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de"
Sep 11 21:25:03.587778 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:03.587757    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de\": container with ID starting with 3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de not found: ID does not exist" containerID="3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de"
Sep 11 21:25:03.587858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.587787    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de"} err="failed to get container status \"3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de\": rpc error: code = NotFound desc = could not find container \"3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de\": container with ID starting with 3207071a314868d8f4c6e2662adf6a9f96b124e24dd4607d87f585e842f564de not found: ID does not exist"
Sep 11 21:25:03.599616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.599589    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kdbdr"]
Sep 11 21:25:03.602909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:03.602884    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kdbdr"]
Sep 11 21:25:04.143155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:04.143118    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee8bfec-5227-4831-81dc-6ce4eb23f45f" path="/var/lib/kubelet/pods/8ee8bfec-5227-4831-81dc-6ce4eb23f45f/volumes"
Sep 11 21:25:10.274830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.274784    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:25:10.275344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.275054    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-stlm9" podUID="b20676aa-5193-4ce0-9d8e-a34898cc9c23" containerName="limitador" containerID="cri-o://2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784" gracePeriod=30
Sep 11 21:25:10.275851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.275744    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:25:10.818616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.818589    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:25:10.828926 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.828900    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20676aa-5193-4ce0-9d8e-a34898cc9c23-config-file\") pod \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") "
Sep 11 21:25:10.829108 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.829093    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kk4q\" (UniqueName: \"kubernetes.io/projected/b20676aa-5193-4ce0-9d8e-a34898cc9c23-kube-api-access-5kk4q\") pod \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\" (UID: \"b20676aa-5193-4ce0-9d8e-a34898cc9c23\") "
Sep 11 21:25:10.829353 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.829327    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b20676aa-5193-4ce0-9d8e-a34898cc9c23-config-file" (OuterVolumeSpecName: "config-file") pod "b20676aa-5193-4ce0-9d8e-a34898cc9c23" (UID: "b20676aa-5193-4ce0-9d8e-a34898cc9c23"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:25:10.829438 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.829397    2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20676aa-5193-4ce0-9d8e-a34898cc9c23-config-file\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:25:10.831142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.831117    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20676aa-5193-4ce0-9d8e-a34898cc9c23-kube-api-access-5kk4q" (OuterVolumeSpecName: "kube-api-access-5kk4q") pod "b20676aa-5193-4ce0-9d8e-a34898cc9c23" (UID: "b20676aa-5193-4ce0-9d8e-a34898cc9c23"). InnerVolumeSpecName "kube-api-access-5kk4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:25:10.929958 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:10.929926    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kk4q\" (UniqueName: \"kubernetes.io/projected/b20676aa-5193-4ce0-9d8e-a34898cc9c23-kube-api-access-5kk4q\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:25:11.624376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.624341    2572 generic.go:356] "Generic (PLEG): container finished" podID="b20676aa-5193-4ce0-9d8e-a34898cc9c23" containerID="2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784" exitCode=0
Sep 11 21:25:11.624752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.624384    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-stlm9"
Sep 11 21:25:11.624752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.624429    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-stlm9" event={"ID":"b20676aa-5193-4ce0-9d8e-a34898cc9c23","Type":"ContainerDied","Data":"2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784"}
Sep 11 21:25:11.624752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.624477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-stlm9" event={"ID":"b20676aa-5193-4ce0-9d8e-a34898cc9c23","Type":"ContainerDied","Data":"9020ead8716183737a309997a580618e627d6296755978eb9982d79294201dc8"}
Sep 11 21:25:11.624752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.624503    2572 scope.go:117] "RemoveContainer" containerID="2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784"
Sep 11 21:25:11.633417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.633398    2572 scope.go:117] "RemoveContainer" containerID="2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784"
Sep 11 21:25:11.633682 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:11.633661    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784\": container with ID starting with 2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784 not found: ID does not exist" containerID="2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784"
Sep 11 21:25:11.633750 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.633695    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784"} err="failed to get container status \"2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784\": rpc error: code = NotFound desc = could not find container \"2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784\": container with ID starting with 2e769d27d40e958662e4257ff9d7a0697094251e1ff94ef6eda89f12a3f79784 not found: ID does not exist"
Sep 11 21:25:11.646589 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.646559    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:25:11.651596 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:11.651571    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-stlm9"]
Sep 11 21:25:12.142914 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:12.142880    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20676aa-5193-4ce0-9d8e-a34898cc9c23" path="/var/lib/kubelet/pods/b20676aa-5193-4ce0-9d8e-a34898cc9c23/volumes"
Sep 11 21:25:13.197453 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.197410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:13.297769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.297733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:13.637269 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.637214    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"]
Sep 11 21:25:13.637858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.637837    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee8bfec-5227-4831-81dc-6ce4eb23f45f" containerName="authorino"
Sep 11 21:25:13.637858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.637858    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee8bfec-5227-4831-81dc-6ce4eb23f45f" containerName="authorino"
Sep 11 21:25:13.638022 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.637876    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20676aa-5193-4ce0-9d8e-a34898cc9c23" containerName="limitador"
Sep 11 21:25:13.638022 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.637887    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20676aa-5193-4ce0-9d8e-a34898cc9c23" containerName="limitador"
Sep 11 21:25:13.638134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.638026    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20676aa-5193-4ce0-9d8e-a34898cc9c23" containerName="limitador"
Sep 11 21:25:13.638134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.638039    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee8bfec-5227-4831-81dc-6ce4eb23f45f" containerName="authorino"
Sep 11 21:25:13.642858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.642836    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.645329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.645306    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:25:13.645572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.645559    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 21:25:13.645650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.645597    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-djvbh\""
Sep 11 21:25:13.646384 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.646364    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 21:25:13.651593 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.651571    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"]
Sep 11 21:25:13.652416 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.652391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4cb067e3-5b4b-4ca2-916c-1fd6d349c274-data\") pod \"postgres-69fb4594cf-5t27p\" (UID: \"4cb067e3-5b4b-4ca2-916c-1fd6d349c274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.652535 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.652455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xz2b\" (UniqueName: \"kubernetes.io/projected/4cb067e3-5b4b-4ca2-916c-1fd6d349c274-kube-api-access-7xz2b\") pod \"postgres-69fb4594cf-5t27p\" (UID: \"4cb067e3-5b4b-4ca2-916c-1fd6d349c274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.670363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.670339    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:13.753214 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.753161    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4cb067e3-5b4b-4ca2-916c-1fd6d349c274-data\") pod \"postgres-69fb4594cf-5t27p\" (UID: \"4cb067e3-5b4b-4ca2-916c-1fd6d349c274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.753428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.753245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xz2b\" (UniqueName: \"kubernetes.io/projected/4cb067e3-5b4b-4ca2-916c-1fd6d349c274-kube-api-access-7xz2b\") pod \"postgres-69fb4594cf-5t27p\" (UID: \"4cb067e3-5b4b-4ca2-916c-1fd6d349c274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.753596 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.753574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4cb067e3-5b4b-4ca2-916c-1fd6d349c274-data\") pod \"postgres-69fb4594cf-5t27p\" (UID: \"4cb067e3-5b4b-4ca2-916c-1fd6d349c274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.761802 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.761773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xz2b\" (UniqueName: \"kubernetes.io/projected/4cb067e3-5b4b-4ca2-916c-1fd6d349c274-kube-api-access-7xz2b\") pod \"postgres-69fb4594cf-5t27p\" (UID: \"4cb067e3-5b4b-4ca2-916c-1fd6d349c274\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:13.954758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:13.954661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:14.228112 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:14.228083    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"]
Sep 11 21:25:14.229939 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:25:14.229916    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb067e3_5b4b_4ca2_916c_1fd6d349c274.slice/crio-1aff163331fc08422f4709556d9772b9c6428053a4b3183f1114b430dcc18b63 WatchSource:0}: Error finding container 1aff163331fc08422f4709556d9772b9c6428053a4b3183f1114b430dcc18b63: Status 404 returned error can't find the container with id 1aff163331fc08422f4709556d9772b9c6428053a4b3183f1114b430dcc18b63
Sep 11 21:25:14.645944 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:14.645909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p" event={"ID":"4cb067e3-5b4b-4ca2-916c-1fd6d349c274","Type":"ContainerStarted","Data":"1aff163331fc08422f4709556d9772b9c6428053a4b3183f1114b430dcc18b63"}
Sep 11 21:25:16.660613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:16.660517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p" event={"ID":"4cb067e3-5b4b-4ca2-916c-1fd6d349c274","Type":"ContainerStarted","Data":"0d261ebbcbd2703596850092b38bce018bcba1e6a49efed8ccee196737150dfd"}
Sep 11 21:25:16.660613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:16.660582    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:16.681209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:16.681159    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p" podStartSLOduration=1.58304464 podStartE2EDuration="3.681144023s" totalImagesPullingTime="2.098099383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:25:16.679276245 +0000 UTC m=+478.991501605" watchObservedRunningTime="2026-09-11 21:25:16.681144023 +0000 UTC m=+478.993369387"
Sep 11 21:25:22.693959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:22.693928    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5t27p"
Sep 11 21:25:23.017584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:23.017554    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:23.364853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:23.364765    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:30.308364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.308326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:30.339348 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.339313    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85f7776c5c-8lxmh"]
Sep 11 21:25:30.346862 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.346840    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.349518 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.349488    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:25:30.349783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.349763    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:25:30.349854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.349768    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:25:30.350488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.350472    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5zwvz\""
Sep 11 21:25:30.356537 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.356514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f7776c5c-8lxmh"]
Sep 11 21:25:30.397154 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.397119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.397317 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.397160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cqs6\" (UniqueName: \"kubernetes.io/projected/5882caec-1737-4757-b137-c2a903622c98-kube-api-access-4cqs6\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.397317 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.397304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.405104 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.405069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:30.498584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.498554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.498739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.498606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.498739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.498661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cqs6\" (UniqueName: \"kubernetes.io/projected/5882caec-1737-4757-b137-c2a903622c98-kube-api-access-4cqs6\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.498739 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:30.498703    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 21:25:30.498860 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:30.498757    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert podName:5882caec-1737-4757-b137-c2a903622c98 nodeName:}" failed. No retries permitted until 2026-09-11 21:25:30.998737496 +0000 UTC m=+493.310962840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert") pod "maas-controller-85f7776c5c-8lxmh" (UID: "5882caec-1737-4757-b137-c2a903622c98") : secret "maas-controller-webhook-cert" not found
Sep 11 21:25:30.498860 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:30.498809    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 21:25:30.498860 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:30.498854    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs podName:5882caec-1737-4757-b137-c2a903622c98 nodeName:}" failed. No retries permitted until 2026-09-11 21:25:30.998842502 +0000 UTC m=+493.311067856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs") pod "maas-controller-85f7776c5c-8lxmh" (UID: "5882caec-1737-4757-b137-c2a903622c98") : secret "maas-controller-metrics-tls" not found
Sep 11 21:25:30.510479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.510451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:30.513025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.513004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cqs6\" (UniqueName: \"kubernetes.io/projected/5882caec-1737-4757-b137-c2a903622c98-kube-api-access-4cqs6\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:30.531785 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.531758    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-5nnsf"]
Sep 11 21:25:30.534221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.534203    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.550588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.550564    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-5nnsf"]
Sep 11 21:25:30.589634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.589544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:30.599633 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.599609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-webhook-cert\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.599755 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.599669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.599795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.599758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn6rw\" (UniqueName: \"kubernetes.io/projected/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-kube-api-access-kn6rw\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.700965 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.700934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.701153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.700992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn6rw\" (UniqueName: \"kubernetes.io/projected/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-kube-api-access-kn6rw\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.701153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.701030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-webhook-cert\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.701153 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:30.701100    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 21:25:30.701347 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:30.701165    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs podName:5b632455-f0a6-434a-ab24-ed2a12c2c0ea nodeName:}" failed. No retries permitted until 2026-09-11 21:25:31.201144393 +0000 UTC m=+493.513369743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs") pod "maas-controller-6b7dbdfb66-5nnsf" (UID: "5b632455-f0a6-434a-ab24-ed2a12c2c0ea") : secret "maas-controller-metrics-tls" not found
Sep 11 21:25:30.703519 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.703494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-webhook-cert\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.709891 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.709872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn6rw\" (UniqueName: \"kubernetes.io/projected/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-kube-api-access-kn6rw\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:30.879188 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:30.879084    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:31.004756 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.004709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:31.004961 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.004868    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:31.007140 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.007111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:31.007288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.007268    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs\") pod \"maas-controller-85f7776c5c-8lxmh\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") " pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:31.207631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.207530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:31.209995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.209969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs\") pod \"maas-controller-6b7dbdfb66-5nnsf\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") " pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:31.258463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.258429    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:31.444636 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.444603    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:31.532739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.532708    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f7776c5c-8lxmh"]
Sep 11 21:25:31.534290 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:25:31.534237    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5882caec_1737_4757_b137_c2a903622c98.slice/crio-2b8425ee1d277d746d1979435a3b305a567ddb13a2e14673579039d38e2f16df WatchSource:0}: Error finding container 2b8425ee1d277d746d1979435a3b305a567ddb13a2e14673579039d38e2f16df: Status 404 returned error can't find the container with id 2b8425ee1d277d746d1979435a3b305a567ddb13a2e14673579039d38e2f16df
Sep 11 21:25:31.730586 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.730560    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-5nnsf"]
Sep 11 21:25:31.732166 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:25:31.732140    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b632455_f0a6_434a_ab24_ed2a12c2c0ea.slice/crio-920933e71c223c9f14dd3acaf13eab75c4cbf79088a7de181d74345a97919fb5 WatchSource:0}: Error finding container 920933e71c223c9f14dd3acaf13eab75c4cbf79088a7de181d74345a97919fb5: Status 404 returned error can't find the container with id 920933e71c223c9f14dd3acaf13eab75c4cbf79088a7de181d74345a97919fb5
Sep 11 21:25:31.744991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.744925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f7776c5c-8lxmh" event={"ID":"5882caec-1737-4757-b137-c2a903622c98","Type":"ContainerStarted","Data":"2b8425ee1d277d746d1979435a3b305a567ddb13a2e14673579039d38e2f16df"}
Sep 11 21:25:31.746039 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:31.746019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf" event={"ID":"5b632455-f0a6-434a-ab24-ed2a12c2c0ea","Type":"ContainerStarted","Data":"920933e71c223c9f14dd3acaf13eab75c4cbf79088a7de181d74345a97919fb5"}
Sep 11 21:25:34.294842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.294807    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:34.391622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.391543    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:34.769181 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.769143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf" event={"ID":"5b632455-f0a6-434a-ab24-ed2a12c2c0ea","Type":"ContainerStarted","Data":"cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa"}
Sep 11 21:25:34.769409 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.769210    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:34.770699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.770674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f7776c5c-8lxmh" event={"ID":"5882caec-1737-4757-b137-c2a903622c98","Type":"ContainerStarted","Data":"15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7"}
Sep 11 21:25:34.770776 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.770720    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:34.789735 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.789689    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf" podStartSLOduration=2.411976578 podStartE2EDuration="4.789670601s" totalImagesPullingTime="2.377694023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:25:34.786556432 +0000 UTC m=+497.098781819" watchObservedRunningTime="2026-09-11 21:25:34.789670601 +0000 UTC m=+497.101895970"
Sep 11 21:25:34.807915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:34.807866    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85f7776c5c-8lxmh" podStartSLOduration=2.238914517 podStartE2EDuration="4.80784948s" totalImagesPullingTime="2.568934963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:25:34.80519813 +0000 UTC m=+497.117423524" watchObservedRunningTime="2026-09-11 21:25:34.80784948 +0000 UTC m=+497.120074848"
Sep 11 21:25:45.778690 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:45.778656    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:45.779057 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:45.778743    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:25:45.852583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:45.852549    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85f7776c5c-8lxmh"]
Sep 11 21:25:45.852764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:45.852737    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85f7776c5c-8lxmh" podUID="5882caec-1737-4757-b137-c2a903622c98" containerName="manager" containerID="cri-o://15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7" gracePeriod=30
Sep 11 21:25:46.098789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.098764    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:46.243027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.242989    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert\") pod \"5882caec-1737-4757-b137-c2a903622c98\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") "
Sep 11 21:25:46.243027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.243036    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs\") pod \"5882caec-1737-4757-b137-c2a903622c98\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") "
Sep 11 21:25:46.243313 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.243059    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cqs6\" (UniqueName: \"kubernetes.io/projected/5882caec-1737-4757-b137-c2a903622c98-kube-api-access-4cqs6\") pod \"5882caec-1737-4757-b137-c2a903622c98\" (UID: \"5882caec-1737-4757-b137-c2a903622c98\") "
Sep 11 21:25:46.245282 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.245222    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5882caec-1737-4757-b137-c2a903622c98" (UID: "5882caec-1737-4757-b137-c2a903622c98"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:25:46.245400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.245312    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5882caec-1737-4757-b137-c2a903622c98" (UID: "5882caec-1737-4757-b137-c2a903622c98"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:25:46.245400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.245317    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5882caec-1737-4757-b137-c2a903622c98-kube-api-access-4cqs6" (OuterVolumeSpecName: "kube-api-access-4cqs6") pod "5882caec-1737-4757-b137-c2a903622c98" (UID: "5882caec-1737-4757-b137-c2a903622c98"). InnerVolumeSpecName "kube-api-access-4cqs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:25:46.344685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.344598    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cqs6\" (UniqueName: \"kubernetes.io/projected/5882caec-1737-4757-b137-c2a903622c98-kube-api-access-4cqs6\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:25:46.344685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.344629    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-webhook-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:25:46.344685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.344638    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5882caec-1737-4757-b137-c2a903622c98-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:25:46.839062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.839032    2572 generic.go:356] "Generic (PLEG): container finished" podID="5882caec-1737-4757-b137-c2a903622c98" containerID="15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7" exitCode=0
Sep 11 21:25:46.839501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.839079    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f7776c5c-8lxmh"
Sep 11 21:25:46.839501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.839122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f7776c5c-8lxmh" event={"ID":"5882caec-1737-4757-b137-c2a903622c98","Type":"ContainerDied","Data":"15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7"}
Sep 11 21:25:46.839501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.839179    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f7776c5c-8lxmh" event={"ID":"5882caec-1737-4757-b137-c2a903622c98","Type":"ContainerDied","Data":"2b8425ee1d277d746d1979435a3b305a567ddb13a2e14673579039d38e2f16df"}
Sep 11 21:25:46.839501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.839203    2572 scope.go:117] "RemoveContainer" containerID="15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7"
Sep 11 21:25:46.848837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.848817    2572 scope.go:117] "RemoveContainer" containerID="15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7"
Sep 11 21:25:46.849094 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:25:46.849072    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7\": container with ID starting with 15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7 not found: ID does not exist" containerID="15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7"
Sep 11 21:25:46.849186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.849100    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7"} err="failed to get container status \"15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7\": rpc error: code = NotFound desc = could not find container \"15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7\": container with ID starting with 15c7f1dea683de1410fa54d040011e9c947796666fe8de46ab49bc479af271c7 not found: ID does not exist"
Sep 11 21:25:46.866331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.866303    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85f7776c5c-8lxmh"]
Sep 11 21:25:46.873349 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:46.873325    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85f7776c5c-8lxmh"]
Sep 11 21:25:48.143171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:25:48.143139    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5882caec-1737-4757-b137-c2a903622c98" path="/var/lib/kubelet/pods/5882caec-1737-4757-b137-c2a903622c98/volumes"
Sep 11 21:26:06.069634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:06.069599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:06.249752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:06.249712    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:07.559718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.559668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:07.742447 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.742401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:07.867613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.867533    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"]
Sep 11 21:26:07.867959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.867947    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5882caec-1737-4757-b137-c2a903622c98" containerName="manager"
Sep 11 21:26:07.868003 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.867961    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5882caec-1737-4757-b137-c2a903622c98" containerName="manager"
Sep 11 21:26:07.868037 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.868024    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5882caec-1737-4757-b137-c2a903622c98" containerName="manager"
Sep 11 21:26:07.874360 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.874335    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:07.889846 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.889825    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 21:26:07.890798 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.890781    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 21:26:07.890852 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.890802    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-czlrt\""
Sep 11 21:26:07.901242 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.901214    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"]
Sep 11 21:26:07.933390 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.933357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqhrk\" (UniqueName: \"kubernetes.io/projected/077f93ee-8a3f-457e-bad4-504611f5a9ba-kube-api-access-tqhrk\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:07.933566 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.933395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-metrics-certs\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:07.933566 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.933432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077f93ee-8a3f-457e-bad4-504611f5a9ba-openshift-service-ca\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:07.933566 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:07.933493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-maas-api-tls\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.026812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.026779    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:08.034769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.034742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqhrk\" (UniqueName: \"kubernetes.io/projected/077f93ee-8a3f-457e-bad4-504611f5a9ba-kube-api-access-tqhrk\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.034769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.034781    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-metrics-certs\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.035006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.034828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077f93ee-8a3f-457e-bad4-504611f5a9ba-openshift-service-ca\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.035006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.034866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-maas-api-tls\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.035579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.035554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077f93ee-8a3f-457e-bad4-504611f5a9ba-openshift-service-ca\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.037443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.037409    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-maas-api-tls\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.037551 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.037531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-metrics-certs\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.057378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.057349    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqhrk\" (UniqueName: \"kubernetes.io/projected/077f93ee-8a3f-457e-bad4-504611f5a9ba-kube-api-access-tqhrk\") pod \"maas-api-ccb8f7bdd-nllnv\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.184597 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.184508    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:08.495774 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.495680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"]
Sep 11 21:26:08.499037 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:26:08.499008    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077f93ee_8a3f_457e_bad4_504611f5a9ba.slice/crio-5b8360a86739f9b06669e264d31691f886a9fb2ea782347e1cbae46832ac0609 WatchSource:0}: Error finding container 5b8360a86739f9b06669e264d31691f886a9fb2ea782347e1cbae46832ac0609: Status 404 returned error can't find the container with id 5b8360a86739f9b06669e264d31691f886a9fb2ea782347e1cbae46832ac0609
Sep 11 21:26:08.881785 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.881742    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:08.978217 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:08.978186    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv" event={"ID":"077f93ee-8a3f-457e-bad4-504611f5a9ba","Type":"ContainerStarted","Data":"5b8360a86739f9b06669e264d31691f886a9fb2ea782347e1cbae46832ac0609"}
Sep 11 21:26:09.290203 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.290157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:09.358812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.358781    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"]
Sep 11 21:26:09.362510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.362489    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.366143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.366033    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b6gt9\""
Sep 11 21:26:09.366143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.366058    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 21:26:09.395536 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.395501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"]
Sep 11 21:26:09.450459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.450421    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvhkb\" (UniqueName: \"kubernetes.io/projected/59b05160-f986-4e91-a63b-804edaabca66-kube-api-access-zvhkb\") pod \"payload-pre-processing-59fbc47bf8-m785w\" (UID: \"59b05160-f986-4e91-a63b-804edaabca66\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.450652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.450543    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b05160-f986-4e91-a63b-804edaabca66-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-m785w\" (UID: \"59b05160-f986-4e91-a63b-804edaabca66\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.551384 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.551287    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvhkb\" (UniqueName: \"kubernetes.io/projected/59b05160-f986-4e91-a63b-804edaabca66-kube-api-access-zvhkb\") pod \"payload-pre-processing-59fbc47bf8-m785w\" (UID: \"59b05160-f986-4e91-a63b-804edaabca66\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.551548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.551387    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b05160-f986-4e91-a63b-804edaabca66-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-m785w\" (UID: \"59b05160-f986-4e91-a63b-804edaabca66\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.552195 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.552174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59b05160-f986-4e91-a63b-804edaabca66-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-m785w\" (UID: \"59b05160-f986-4e91-a63b-804edaabca66\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.577831 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.577799    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvhkb\" (UniqueName: \"kubernetes.io/projected/59b05160-f986-4e91-a63b-804edaabca66-kube-api-access-zvhkb\") pod \"payload-pre-processing-59fbc47bf8-m785w\" (UID: \"59b05160-f986-4e91-a63b-804edaabca66\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:09.675825 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:09.675780    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:10.202554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:10.202524    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"]
Sep 11 21:26:10.204056 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:26:10.204028    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b05160_f986_4e91_a63b_804edaabca66.slice/crio-7980684da30c1e19bdad33fbe33d8d992a638a55ddde57319dbfb2bd1536a019 WatchSource:0}: Error finding container 7980684da30c1e19bdad33fbe33d8d992a638a55ddde57319dbfb2bd1536a019: Status 404 returned error can't find the container with id 7980684da30c1e19bdad33fbe33d8d992a638a55ddde57319dbfb2bd1536a019
Sep 11 21:26:10.998947 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:10.998907    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w" event={"ID":"59b05160-f986-4e91-a63b-804edaabca66","Type":"ContainerStarted","Data":"7980684da30c1e19bdad33fbe33d8d992a638a55ddde57319dbfb2bd1536a019"}
Sep 11 21:26:11.000627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:11.000601    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv" event={"ID":"077f93ee-8a3f-457e-bad4-504611f5a9ba","Type":"ContainerStarted","Data":"f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac"}
Sep 11 21:26:11.000768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:11.000719    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:11.029063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:11.029013    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv" podStartSLOduration=2.5539086810000002 podStartE2EDuration="4.028998379s" totalImagesPullingTime="1.475089698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:11.027060773 +0000 UTC m=+533.339286138" watchObservedRunningTime="2026-09-11 21:26:11.028998379 +0000 UTC m=+533.341223745"
Sep 11 21:26:12.008757 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:12.008721    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w" event={"ID":"59b05160-f986-4e91-a63b-804edaabca66","Type":"ContainerStarted","Data":"1dee2bd4e05b5f825c65fb92fe9f24d98663657c53f75aedb5a89db903be7644"}
Sep 11 21:26:12.009169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:12.008926    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:17.013760 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:17.013730    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:26:17.039483 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:17.039425    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w" podStartSLOduration=6.598551532 podStartE2EDuration="8.039404228s" totalImagesPullingTime="1.440852696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:12.030139762 +0000 UTC m=+534.342365128" watchObservedRunningTime="2026-09-11 21:26:17.039404228 +0000 UTC m=+539.351629595"
Sep 11 21:26:18.126430 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:18.126399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:18.276013 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:18.275975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:23.016616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:23.016582    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-m785w"
Sep 11 21:26:42.726197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:42.726157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:45.134758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:45.134718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:50.605742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.605710    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"]
Sep 11 21:26:50.608432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.608414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.613510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.613478    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 21:26:50.614407 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.614383    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hc7mn\""
Sep 11 21:26:50.614674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.614656    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 21:26:50.614751 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.614730    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 21:26:50.621146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621122    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"]
Sep 11 21:26:50.621545 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.621628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.621675 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.621714 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5d7w\" (UniqueName: \"kubernetes.io/projected/cafd7637-47b1-4e6f-8d84-2708734d5c24-kube-api-access-j5d7w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.621752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cafd7637-47b1-4e6f-8d84-2708734d5c24-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.621813 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.621790    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.638984 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.638955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:50.723011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.722978    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723050    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5d7w\" (UniqueName: \"kubernetes.io/projected/cafd7637-47b1-4e6f-8d84-2708734d5c24-kube-api-access-j5d7w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cafd7637-47b1-4e6f-8d84-2708734d5c24-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723519 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723564 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723534    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.723598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.723568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.725377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.725345    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cafd7637-47b1-4e6f-8d84-2708734d5c24-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.725556 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.725539    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cafd7637-47b1-4e6f-8d84-2708734d5c24-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.732192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.732169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5d7w\" (UniqueName: \"kubernetes.io/projected/cafd7637-47b1-4e6f-8d84-2708734d5c24-kube-api-access-j5d7w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2pbnx\" (UID: \"cafd7637-47b1-4e6f-8d84-2708734d5c24\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:50.919317 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:50.919214    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:26:51.196083 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:51.196056    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"]
Sep 11 21:26:51.197570 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:26:51.197542    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafd7637_47b1_4e6f_8d84_2708734d5c24.slice/crio-737deb214f65b237fc33c086a72757b8af1d43abbb1a60eb6478abed21240664 WatchSource:0}: Error finding container 737deb214f65b237fc33c086a72757b8af1d43abbb1a60eb6478abed21240664: Status 404 returned error can't find the container with id 737deb214f65b237fc33c086a72757b8af1d43abbb1a60eb6478abed21240664
Sep 11 21:26:51.228715 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:51.228681    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx" event={"ID":"cafd7637-47b1-4e6f-8d84-2708734d5c24","Type":"ContainerStarted","Data":"737deb214f65b237fc33c086a72757b8af1d43abbb1a60eb6478abed21240664"}
Sep 11 21:26:53.246868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:53.246816    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx" event={"ID":"cafd7637-47b1-4e6f-8d84-2708734d5c24","Type":"ContainerStarted","Data":"b9d2a9b97435b609e340aec9aa0a54024b2c71c1f240fb54e02d9b0f90e8d52c"}
Sep 11 21:26:53.268129 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:53.268074    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx" podStartSLOduration=2.254416505 podStartE2EDuration="3.268058925s" totalImagesPullingTime="1.01364242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:53.266010362 +0000 UTC m=+575.578235727" watchObservedRunningTime="2026-09-11 21:26:53.268058925 +0000 UTC m=+575.580284322"
Sep 11 21:26:56.205071 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.205034    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"]
Sep 11 21:26:56.208875 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.208852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.211878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.211856    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 21:26:56.225312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.225284    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"]
Sep 11 21:26:56.271350 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.271554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/028d1807-9156-450c-baf7-b9f3b70ba67f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.271554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6gd\" (UniqueName: \"kubernetes.io/projected/028d1807-9156-450c-baf7-b9f3b70ba67f-kube-api-access-wv6gd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.271554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.271554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271500    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.271770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271594    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.271770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.271641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:56.372495 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/028d1807-9156-450c-baf7-b9f3b70ba67f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6gd\" (UniqueName: \"kubernetes.io/projected/028d1807-9156-450c-baf7-b9f3b70ba67f-kube-api-access-wv6gd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.372974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.372932    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.373059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.373039    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.374877 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.374854    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/028d1807-9156-450c-baf7-b9f3b70ba67f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.375053 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.375033    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/028d1807-9156-450c-baf7-b9f3b70ba67f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.382547 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.382522    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6gd\" (UniqueName: \"kubernetes.io/projected/028d1807-9156-450c-baf7-b9f3b70ba67f-kube-api-access-wv6gd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6\" (UID: \"028d1807-9156-450c-baf7-b9f3b70ba67f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.519121 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.519084    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:26:56.799127 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:56.799094    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"]
Sep 11 21:26:56.801237 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:26:56.801211    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028d1807_9156_450c_baf7_b9f3b70ba67f.slice/crio-1855f79fc2d8c2fd1eb520d88eb1af59e9b818e028ad51ca5eda21e55c2a59be WatchSource:0}: Error finding container 1855f79fc2d8c2fd1eb520d88eb1af59e9b818e028ad51ca5eda21e55c2a59be: Status 404 returned error can't find the container with id 1855f79fc2d8c2fd1eb520d88eb1af59e9b818e028ad51ca5eda21e55c2a59be
Sep 11 21:26:57.269358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:57.269322    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6" event={"ID":"028d1807-9156-450c-baf7-b9f3b70ba67f","Type":"ContainerStarted","Data":"8627f8486725824d757108cc263b723d41c7321df7493a02d4eda8b9bccb1ebb"}
Sep 11 21:26:57.269841 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:57.269373    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6" event={"ID":"028d1807-9156-450c-baf7-b9f3b70ba67f","Type":"ContainerStarted","Data":"1855f79fc2d8c2fd1eb520d88eb1af59e9b818e028ad51ca5eda21e55c2a59be"}
Sep 11 21:26:57.309981 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:26:57.309927    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6" podStartSLOduration=1.120691522 podStartE2EDuration="1.309908703s" totalImagesPullingTime="189.217181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:26:57.309766259 +0000 UTC m=+579.621991636" watchObservedRunningTime="2026-09-11 21:26:57.309908703 +0000 UTC m=+579.622134069"
Sep 11 21:27:00.202744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:00.202707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:00.919883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:00.919849    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:27:00.920060 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:00.919911    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:27:00.932349 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:00.932312    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:27:01.302833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:01.302805    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2pbnx"
Sep 11 21:27:06.519498 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:06.519444    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:27:06.519909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:06.519536    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:27:06.531966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:06.531935    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:27:07.334668 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:07.334636    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6"
Sep 11 21:27:15.343429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:15.343385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:18.103331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:18.103302    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:27:18.103331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:18.103330    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:27:28.483516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:28.483484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:45.820622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:45.820542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:57.609220 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:57.609186    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:57.728857 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:27:57.728821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:04.589625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:28:04.589584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:26.955569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:28:26.955533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:04.890178 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:04.890134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:04.982963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:04.982930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:05.125504 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:05.125462    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:05.217208 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:05.217103    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:06.036935 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:06.036901    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:06.137309 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:06.137277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:13.894414 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:13.894332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:21.611184 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:21.611149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:21.748915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:21.748878    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:21.995478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:21.995387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:22.324741 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:22.324704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:22.510993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:22.510947    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:22.607054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:22.606937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:22.851944 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:22.851908    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:23.144868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.144832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:23.244603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.244558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:23.603820 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.603761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:23.738071 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.738039    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7819-af2af1"]
Sep 11 21:29:23.741631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.741614    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:23.744936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.744912    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ns82b\""
Sep 11 21:29:23.749894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.749870    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7819-af2af1"]
Sep 11 21:29:23.808276 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.808225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9d7s\" (UniqueName: \"kubernetes.io/projected/a714c26d-34ea-4965-a330-66190f4d5bf4-kube-api-access-x9d7s\") pod \"test-curl-7819-af2af1\" (UID: \"a714c26d-34ea-4965-a330-66190f4d5bf4\") " pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:23.909379 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.909300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9d7s\" (UniqueName: \"kubernetes.io/projected/a714c26d-34ea-4965-a330-66190f4d5bf4-kube-api-access-x9d7s\") pod \"test-curl-7819-af2af1\" (UID: \"a714c26d-34ea-4965-a330-66190f4d5bf4\") " pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:23.919050 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:23.919026    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9d7s\" (UniqueName: \"kubernetes.io/projected/a714c26d-34ea-4965-a330-66190f4d5bf4-kube-api-access-x9d7s\") pod \"test-curl-7819-af2af1\" (UID: \"a714c26d-34ea-4965-a330-66190f4d5bf4\") " pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:24.051657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:24.051619    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:24.330147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:24.330122    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7819-af2af1"]
Sep 11 21:29:24.332711 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:24.332684    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda714c26d_34ea_4965_a330_66190f4d5bf4.slice/crio-627f534e8647533eaceb44f0a1a20f01a4d104abc757def2746b49a5e0e7bae8 WatchSource:0}: Error finding container 627f534e8647533eaceb44f0a1a20f01a4d104abc757def2746b49a5e0e7bae8: Status 404 returned error can't find the container with id 627f534e8647533eaceb44f0a1a20f01a4d104abc757def2746b49a5e0e7bae8
Sep 11 21:29:24.335090 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:24.335067    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:29:25.110558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:25.110522    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7819-af2af1" event={"ID":"a714c26d-34ea-4965-a330-66190f4d5bf4","Type":"ContainerStarted","Data":"627f534e8647533eaceb44f0a1a20f01a4d104abc757def2746b49a5e0e7bae8"}
Sep 11 21:29:25.241024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:25.240985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:25.466305 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:25.466194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:25.702095 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:25.702055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:25.847804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:25.847769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:27.132242 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.132204    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7819-af2af1" event={"ID":"a714c26d-34ea-4965-a330-66190f4d5bf4","Type":"ContainerStarted","Data":"615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e"}
Sep 11 21:29:27.182770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.182718    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7819-af2af1" podStartSLOduration=2.003641031 podStartE2EDuration="4.182701179s" totalImagesPullingTime="2.179060148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:27.17161109 +0000 UTC m=+729.483836457" watchObservedRunningTime="2026-09-11 21:29:27.182701179 +0000 UTC m=+729.494926571"
Sep 11 21:29:27.270700 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.270668    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"]
Sep 11 21:29:27.274568 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.274545    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.278317 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.278297    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-db06d6-serving-cert\""
Sep 11 21:29:27.295945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.295918    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"]
Sep 11 21:29:27.334026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.333992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:27.341455 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.341430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-metrics-certs\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.341585 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.341471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lr9\" (UniqueName: \"kubernetes.io/projected/b75fb4dc-54c7-402c-b3f9-386d2e022b76-kube-api-access-58lr9\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.341639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.341605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75fb4dc-54c7-402c-b3f9-386d2e022b76-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.341682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.341641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.442699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.442597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75fb4dc-54c7-402c-b3f9-386d2e022b76-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.442699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.442649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.442929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.442703    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-metrics-certs\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.442929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.442727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58lr9\" (UniqueName: \"kubernetes.io/projected/b75fb4dc-54c7-402c-b3f9-386d2e022b76-kube-api-access-58lr9\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.442929 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:27.442770    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-serving-cert: secret "maas-api-e2e-worker-w0-db06d6-serving-cert" not found
Sep 11 21:29:27.442929 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:27.442843    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls podName:b75fb4dc-54c7-402c-b3f9-386d2e022b76 nodeName:}" failed. No retries permitted until 2026-09-11 21:29:27.942822896 +0000 UTC m=+730.255048257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls") pod "maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" (UID: "b75fb4dc-54c7-402c-b3f9-386d2e022b76") : secret "maas-api-e2e-worker-w0-db06d6-serving-cert" not found
Sep 11 21:29:27.443503 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.443481    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75fb4dc-54c7-402c-b3f9-386d2e022b76-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.445285 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.445246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-metrics-certs\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.452290 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.452270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lr9\" (UniqueName: \"kubernetes.io/projected/b75fb4dc-54c7-402c-b3f9-386d2e022b76-kube-api-access-58lr9\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.464619 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.464596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:27.568579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.568553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:27.948568 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.948531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.951150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.951125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls\") pod \"maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:27.953080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.953060    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7819-af2af1"]
Sep 11 21:29:27.958535 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:27.958514    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7819-af2af1"]
Sep 11 21:29:28.125753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.125715    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7819-5ae13d"]
Sep 11 21:29:28.126150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.126136    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" containerName="test-curl-7819-af2af1"
Sep 11 21:29:28.126150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.126151    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" containerName="test-curl-7819-af2af1"
Sep 11 21:29:28.126237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.126218    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" containerName="test-curl-7819-af2af1"
Sep 11 21:29:28.129738 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.129720    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:28.138738 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:28.138711    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7819-af2af1" container="test-curl-7819-af2af1"
Sep 11 21:29:28.165733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.165703    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7819-5ae13d"]
Sep 11 21:29:28.184954 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.184923    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:28.250648 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.250618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5898t\" (UniqueName: \"kubernetes.io/projected/dca738af-51f2-4659-b765-78a187d2d3ad-kube-api-access-5898t\") pod \"test-curl-7819-5ae13d\" (UID: \"dca738af-51f2-4659-b765-78a187d2d3ad\") " pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:28.251639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.251605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:28.351525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.351493    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5898t\" (UniqueName: \"kubernetes.io/projected/dca738af-51f2-4659-b765-78a187d2d3ad-kube-api-access-5898t\") pod \"test-curl-7819-5ae13d\" (UID: \"dca738af-51f2-4659-b765-78a187d2d3ad\") " pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:28.368597 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.368568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5898t\" (UniqueName: \"kubernetes.io/projected/dca738af-51f2-4659-b765-78a187d2d3ad-kube-api-access-5898t\") pod \"test-curl-7819-5ae13d\" (UID: \"dca738af-51f2-4659-b765-78a187d2d3ad\") " pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:28.440590 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.440507    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:28.455593 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.455564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:28.521751 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.521721    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"]
Sep 11 21:29:28.523335 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:28.523308    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75fb4dc_54c7_402c_b3f9_386d2e022b76.slice/crio-85358c73eebc1691e93d0cf3d111fe3cb1c5a02425afefd4ecad2a78bc18cc9d WatchSource:0}: Error finding container 85358c73eebc1691e93d0cf3d111fe3cb1c5a02425afefd4ecad2a78bc18cc9d: Status 404 returned error can't find the container with id 85358c73eebc1691e93d0cf3d111fe3cb1c5a02425afefd4ecad2a78bc18cc9d
Sep 11 21:29:28.733275 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:28.733238    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7819-5ae13d"]
Sep 11 21:29:28.734595 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:28.734567    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca738af_51f2_4659_b765_78a187d2d3ad.slice/crio-5301b212de31fd29a48f4b15c7c90a2d429182e58df6d8269841b3378dd27c12 WatchSource:0}: Error finding container 5301b212de31fd29a48f4b15c7c90a2d429182e58df6d8269841b3378dd27c12: Status 404 returned error can't find the container with id 5301b212de31fd29a48f4b15c7c90a2d429182e58df6d8269841b3378dd27c12
Sep 11 21:29:29.145865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.145827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7819-5ae13d" event={"ID":"dca738af-51f2-4659-b765-78a187d2d3ad","Type":"ContainerStarted","Data":"afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582"}
Sep 11 21:29:29.145865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.145880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7819-5ae13d" event={"ID":"dca738af-51f2-4659-b765-78a187d2d3ad","Type":"ContainerStarted","Data":"5301b212de31fd29a48f4b15c7c90a2d429182e58df6d8269841b3378dd27c12"}
Sep 11 21:29:29.147628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.147603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" event={"ID":"b75fb4dc-54c7-402c-b3f9-386d2e022b76","Type":"ContainerStarted","Data":"ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a"}
Sep 11 21:29:29.147777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.147650    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7819-af2af1" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" containerName="test-curl-7819-af2af1" containerID="cri-o://615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e" gracePeriod=2
Sep 11 21:29:29.147777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.147657    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" event={"ID":"b75fb4dc-54c7-402c-b3f9-386d2e022b76","Type":"ContainerStarted","Data":"85358c73eebc1691e93d0cf3d111fe3cb1c5a02425afefd4ecad2a78bc18cc9d"}
Sep 11 21:29:29.147886 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.147780    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:29.202527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.202475    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7819-5ae13d" podStartSLOduration=1.202456307 podStartE2EDuration="1.202456307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:29.201396125 +0000 UTC m=+731.513621492" watchObservedRunningTime="2026-09-11 21:29:29.202456307 +0000 UTC m=+731.514681673"
Sep 11 21:29:29.206059 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:29.206028    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:29.306544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.306494    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" podStartSLOduration=1.897445447 podStartE2EDuration="2.306471997s" totalImagesPullingTime="409.02655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:29.298331801 +0000 UTC m=+731.610557163" watchObservedRunningTime="2026-09-11 21:29:29.306471997 +0000 UTC m=+731.618697366"
Sep 11 21:29:29.344212 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.344176    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"]
Sep 11 21:29:29.348180 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.348157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.354178 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.354150    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-83ba87-serving-cert\""
Sep 11 21:29:29.392420 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.392392    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"]
Sep 11 21:29:29.453397 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:29.453358    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:29.460828 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.460799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77257\" (UniqueName: \"kubernetes.io/projected/60464de7-47aa-4bdb-a4f1-966b56269275-kube-api-access-77257\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.460895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.460840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-maas-api-tls\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.460942 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.460931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60464de7-47aa-4bdb-a4f1-966b56269275-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.460976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.460953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-metrics-certs\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.546427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.546380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:29.561881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.561806    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60464de7-47aa-4bdb-a4f1-966b56269275-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.561881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.561845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-metrics-certs\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.562067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.561923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77257\" (UniqueName: \"kubernetes.io/projected/60464de7-47aa-4bdb-a4f1-966b56269275-kube-api-access-77257\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.562067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.561950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-maas-api-tls\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.562526 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.562504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60464de7-47aa-4bdb-a4f1-966b56269275-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.564384 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.564363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-maas-api-tls\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.564482 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.564443    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-metrics-certs\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.582527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.582508    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77257\" (UniqueName: \"kubernetes.io/projected/60464de7-47aa-4bdb-a4f1-966b56269275-kube-api-access-77257\") pod \"maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.660071 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.660033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:29.707842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.707797    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:29.952944 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:29.952914    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"]
Sep 11 21:29:29.953441 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:29.953404    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60464de7_47aa_4bdb_a4f1_966b56269275.slice/crio-7bfb6dbe8f526c85b1edc6b37928ce07270fd8f60036a5196e7a8a3076f58bcb WatchSource:0}: Error finding container 7bfb6dbe8f526c85b1edc6b37928ce07270fd8f60036a5196e7a8a3076f58bcb: Status 404 returned error can't find the container with id 7bfb6dbe8f526c85b1edc6b37928ce07270fd8f60036a5196e7a8a3076f58bcb
Sep 11 21:29:30.092339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:30.092298    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7819-5ae13d"]
Sep 11 21:29:30.111049 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:30.111017    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7819-5ae13d"]
Sep 11 21:29:30.154991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:30.154949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm" event={"ID":"60464de7-47aa-4bdb-a4f1-966b56269275","Type":"ContainerStarted","Data":"7bfb6dbe8f526c85b1edc6b37928ce07270fd8f60036a5196e7a8a3076f58bcb"}
Sep 11 21:29:30.155473 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:30.155443    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7819-5ae13d" container="test-curl-7819-5ae13d"
Sep 11 21:29:30.421646 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:30.421610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:30.687126 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:30.687018    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:30.879549 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:30.879514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.162959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.162922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm" event={"ID":"60464de7-47aa-4bdb-a4f1-966b56269275","Type":"ContainerStarted","Data":"c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c"}
Sep 11 21:29:31.163353 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.162976    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7819-5ae13d" podUID="dca738af-51f2-4659-b765-78a187d2d3ad" containerName="test-curl-7819-5ae13d" containerID="cri-o://afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582" gracePeriod=2
Sep 11 21:29:31.225420 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.225364    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm" podStartSLOduration=1.848576251 podStartE2EDuration="2.225346621s" totalImagesPullingTime="376.77037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:31.222830748 +0000 UTC m=+733.535056126" watchObservedRunningTime="2026-09-11 21:29:31.225346621 +0000 UTC m=+733.537571986"
Sep 11 21:29:31.335377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.335348    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:31.342703 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:31.342672    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:31.381685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.381655    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9d7s\" (UniqueName: \"kubernetes.io/projected/a714c26d-34ea-4965-a330-66190f4d5bf4-kube-api-access-x9d7s\") pod \"a714c26d-34ea-4965-a330-66190f4d5bf4\" (UID: \"a714c26d-34ea-4965-a330-66190f4d5bf4\") "
Sep 11 21:29:31.383671 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.383647    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a714c26d-34ea-4965-a330-66190f4d5bf4-kube-api-access-x9d7s" (OuterVolumeSpecName: "kube-api-access-x9d7s") pod "a714c26d-34ea-4965-a330-66190f4d5bf4" (UID: "a714c26d-34ea-4965-a330-66190f4d5bf4"). InnerVolumeSpecName "kube-api-access-x9d7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:31.482461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.482370    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9d7s\" (UniqueName: \"kubernetes.io/projected/a714c26d-34ea-4965-a330-66190f4d5bf4-kube-api-access-x9d7s\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.491418 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.491389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.867854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.867821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.878466 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.878435    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"]
Sep 11 21:29:31.878876 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.878865    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca738af-51f2-4659-b765-78a187d2d3ad" containerName="test-curl-7819-5ae13d"
Sep 11 21:29:31.878921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.878878    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca738af-51f2-4659-b765-78a187d2d3ad" containerName="test-curl-7819-5ae13d"
Sep 11 21:29:31.878974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.878965    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca738af-51f2-4659-b765-78a187d2d3ad" containerName="test-curl-7819-5ae13d"
Sep 11 21:29:31.882146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.882129    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:31.884816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.884796    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-1a1e3a-serving-cert\""
Sep 11 21:29:31.909732 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.909703    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"]
Sep 11 21:29:31.930182 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:31.930134    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:31.986558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.986521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b750af2b-f06f-4c20-aae9-41acb379412f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:31.986724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.986587    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qv2m\" (UniqueName: \"kubernetes.io/projected/b750af2b-f06f-4c20-aae9-41acb379412f-kube-api-access-7qv2m\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:31.986724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.986640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:31.986724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.986662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-metrics-certs\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:31.992624 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:31.992596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:32.087772 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.087739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qv2m\" (UniqueName: \"kubernetes.io/projected/b750af2b-f06f-4c20-aae9-41acb379412f-kube-api-access-7qv2m\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.087772 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.087784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.088045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.087807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-metrics-certs\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.088045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.087901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b750af2b-f06f-4c20-aae9-41acb379412f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.088045 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:32.087922    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-serving-cert: secret "maas-api-e2e-inf-a-1a1e3a-serving-cert" not found
Sep 11 21:29:32.088045 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:32.087995    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls podName:b750af2b-f06f-4c20-aae9-41acb379412f nodeName:}" failed. No retries permitted until 2026-09-11 21:29:32.587972718 +0000 UTC m=+734.900198078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls") pod "maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" (UID: "b750af2b-f06f-4c20-aae9-41acb379412f") : secret "maas-api-e2e-inf-a-1a1e3a-serving-cert" not found
Sep 11 21:29:32.088619 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.088592    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b750af2b-f06f-4c20-aae9-41acb379412f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.090289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.090274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-metrics-certs\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.099408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.099388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qv2m\" (UniqueName: \"kubernetes.io/projected/b750af2b-f06f-4c20-aae9-41acb379412f-kube-api-access-7qv2m\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.143904 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.143822    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" path="/var/lib/kubelet/pods/a714c26d-34ea-4965-a330-66190f4d5bf4/volumes"
Sep 11 21:29:32.169824 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.169794    2572 generic.go:356] "Generic (PLEG): container finished" podID="a714c26d-34ea-4965-a330-66190f4d5bf4" containerID="615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e" exitCode=137
Sep 11 21:29:32.170244 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.169831    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:32.170244 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.169889    2572 scope.go:117] "RemoveContainer" containerID="615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e"
Sep 11 21:29:32.170244 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.170017    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:32.172318 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:32.172294    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:32.174931 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:32.174908    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:32.178995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.178966    2572 scope.go:117] "RemoveContainer" containerID="615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e"
Sep 11 21:29:32.179294 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:32.179272    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e\": container with ID starting with 615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e not found: ID does not exist" containerID="615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e"
Sep 11 21:29:32.179354 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.179307    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e"} err="failed to get container status \"615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e\": rpc error: code = NotFound desc = could not find container \"615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e\": container with ID starting with 615d56546ed11ec2b73d3d815f8687641aba426050a27097b755e60dc5a7b26e not found: ID does not exist"
Sep 11 21:29:32.593983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.593947    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.596523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.596498    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls\") pod \"maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.607100 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.607071    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:32.712576 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.712540    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:32.774377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.774340    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"]
Sep 11 21:29:32.779235 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.779217    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:32.782237 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:32.782201    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:32.782237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.782235    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1a1e3a\""
Sep 11 21:29:32.790960 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.790932    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"]
Sep 11 21:29:32.792198 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.792174    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:32.807382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.807357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:32.896425 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.896388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flfcl\" (UniqueName: \"kubernetes.io/projected/7d31ad3f-a508-424b-886c-439d016c8f5c-kube-api-access-flfcl\") pod \"payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:32.896598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.896442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d31ad3f-a508-424b-886c-439d016c8f5c-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:32.998176 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.998133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flfcl\" (UniqueName: \"kubernetes.io/projected/7d31ad3f-a508-424b-886c-439d016c8f5c-kube-api-access-flfcl\") pod \"payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:32.998360 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.998210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d31ad3f-a508-424b-886c-439d016c8f5c-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:32.998920 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:32.998900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d31ad3f-a508-424b-886c-439d016c8f5c-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:33.012019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.011981    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flfcl\" (UniqueName: \"kubernetes.io/projected/7d31ad3f-a508-424b-886c-439d016c8f5c-kube-api-access-flfcl\") pod \"payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:33.079449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.079416    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"]
Sep 11 21:29:33.081275 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:33.081229    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb750af2b_f06f_4c20_aae9_41acb379412f.slice/crio-09ba7455f279d2cdf8eae7db2f226656176be1d076699480fb4a6fd591ef97c0 WatchSource:0}: Error finding container 09ba7455f279d2cdf8eae7db2f226656176be1d076699480fb4a6fd591ef97c0: Status 404 returned error can't find the container with id 09ba7455f279d2cdf8eae7db2f226656176be1d076699480fb4a6fd591ef97c0
Sep 11 21:29:33.091079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.091061    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:33.180351 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.180323    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" event={"ID":"b750af2b-f06f-4c20-aae9-41acb379412f","Type":"ContainerStarted","Data":"09ba7455f279d2cdf8eae7db2f226656176be1d076699480fb4a6fd591ef97c0"}
Sep 11 21:29:33.342656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.342597    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:33.346390 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.345349    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:33.347949 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:33.347904    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7819-af2af1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="a714c26d-34ea-4965-a330-66190f4d5bf4" pod="opendatahub/test-curl-7819-af2af1"
Sep 11 21:29:33.375221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.375184    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"]
Sep 11 21:29:33.376196 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:33.376168    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d31ad3f_a508_424b_886c_439d016c8f5c.slice/crio-f617ee623216db1a287c9db06fbd3f430614733c14dac52cb83f1727d35fd826 WatchSource:0}: Error finding container f617ee623216db1a287c9db06fbd3f430614733c14dac52cb83f1727d35fd826: Status 404 returned error can't find the container with id f617ee623216db1a287c9db06fbd3f430614733c14dac52cb83f1727d35fd826
Sep 11 21:29:33.401656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.401632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5898t\" (UniqueName: \"kubernetes.io/projected/dca738af-51f2-4659-b765-78a187d2d3ad-kube-api-access-5898t\") pod \"dca738af-51f2-4659-b765-78a187d2d3ad\" (UID: \"dca738af-51f2-4659-b765-78a187d2d3ad\") "
Sep 11 21:29:33.403499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.403476    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca738af-51f2-4659-b765-78a187d2d3ad-kube-api-access-5898t" (OuterVolumeSpecName: "kube-api-access-5898t") pod "dca738af-51f2-4659-b765-78a187d2d3ad" (UID: "dca738af-51f2-4659-b765-78a187d2d3ad"). InnerVolumeSpecName "kube-api-access-5898t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:33.503515 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:33.503379    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5898t\" (UniqueName: \"kubernetes.io/projected/dca738af-51f2-4659-b765-78a187d2d3ad-kube-api-access-5898t\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:29:34.144851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.144820    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca738af-51f2-4659-b765-78a187d2d3ad" path="/var/lib/kubelet/pods/dca738af-51f2-4659-b765-78a187d2d3ad/volumes"
Sep 11 21:29:34.187258 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.187222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" event={"ID":"b750af2b-f06f-4c20-aae9-41acb379412f","Type":"ContainerStarted","Data":"9df7da36acebc64b34b8e8ab66048cca540b9a3196ee43adb04eb21e96036fb2"}
Sep 11 21:29:34.187691 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.187306    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:34.188595 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.188573    2572 generic.go:356] "Generic (PLEG): container finished" podID="dca738af-51f2-4659-b765-78a187d2d3ad" containerID="afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582" exitCode=137
Sep 11 21:29:34.188674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.188607    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7819-5ae13d"
Sep 11 21:29:34.188674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.188666    2572 scope.go:117] "RemoveContainer" containerID="afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582"
Sep 11 21:29:34.190522 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.190496    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz" event={"ID":"7d31ad3f-a508-424b-886c-439d016c8f5c","Type":"ContainerStarted","Data":"1faf451a57a9188e365df4d7fc61ceb3d562a671a03bc8bdaff60f1f6f5978f2"}
Sep 11 21:29:34.190658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.190549    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz" event={"ID":"7d31ad3f-a508-424b-886c-439d016c8f5c","Type":"ContainerStarted","Data":"f617ee623216db1a287c9db06fbd3f430614733c14dac52cb83f1727d35fd826"}
Sep 11 21:29:34.190658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.190599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:34.200025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.199841    2572 scope.go:117] "RemoveContainer" containerID="afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582"
Sep 11 21:29:34.200190 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:34.200168    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582\": container with ID starting with afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582 not found: ID does not exist" containerID="afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582"
Sep 11 21:29:34.200275 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.200202    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582"} err="failed to get container status \"afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582\": rpc error: code = NotFound desc = could not find container \"afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582\": container with ID starting with afa9d19ee0c39479bc1017c5517369e50ad3bdf05f05cf5e5facbc1498ba0582 not found: ID does not exist"
Sep 11 21:29:34.244233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.244179    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" podStartSLOduration=2.881765842 podStartE2EDuration="3.244157518s" totalImagesPullingTime="362.391676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:34.243723561 +0000 UTC m=+736.555948929" watchObservedRunningTime="2026-09-11 21:29:34.244157518 +0000 UTC m=+736.556382884"
Sep 11 21:29:34.623346 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.623311    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:34.724231 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.724198    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:34.826700 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.826652    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:34.933032 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:34.932939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:35.160718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:35.160689    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:29:35.192909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:35.192792    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz" podStartSLOduration=3.1927740079999998 podStartE2EDuration="3.192774008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:34.291787777 +0000 UTC m=+736.604013142" watchObservedRunningTime="2026-09-11 21:29:35.192774008 +0000 UTC m=+737.504999378"
Sep 11 21:29:35.253018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:35.252723    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:35.534158 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:35.534123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:35.756487 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:35.756448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:36.709868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:36.709831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:36.811682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:36.811636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:36.913376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:36.913346    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:37.351714 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.351676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:37.448070 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.448033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:37.536426 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.536388    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"]
Sep 11 21:29:37.541444 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.541426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.544070 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.544046    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-1e9b41-dockercfg-8mnml\""
Sep 11 21:29:37.548002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.544375    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-1e9b41\""
Sep 11 21:29:37.556499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.556470    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"]
Sep 11 21:29:37.645051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.644971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7849f1fa-1ad4-4774-9d3d-488942e5335b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.645186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.645079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2xwt\" (UniqueName: \"kubernetes.io/projected/7849f1fa-1ad4-4774-9d3d-488942e5335b-kube-api-access-n2xwt\") pod \"payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.745710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.745675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7849f1fa-1ad4-4774-9d3d-488942e5335b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.746109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.745737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2xwt\" (UniqueName: \"kubernetes.io/projected/7849f1fa-1ad4-4774-9d3d-488942e5335b-kube-api-access-n2xwt\") pod \"payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.746474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.746453    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7849f1fa-1ad4-4774-9d3d-488942e5335b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.754572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.754545    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2xwt\" (UniqueName: \"kubernetes.io/projected/7849f1fa-1ad4-4774-9d3d-488942e5335b-kube-api-access-n2xwt\") pod \"payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.832157 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.832124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:37.864189 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.864154    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:37.929245 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:37.929209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:38.162402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:38.162378    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"]
Sep 11 21:29:38.163092 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:38.163072    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7849f1fa_1ad4_4774_9d3d_488942e5335b.slice/crio-d5e722dc784d1d60bc73461deb9ae36cf1c05eb9328040356048bd1ec3ba7bc1 WatchSource:0}: Error finding container d5e722dc784d1d60bc73461deb9ae36cf1c05eb9328040356048bd1ec3ba7bc1: Status 404 returned error can't find the container with id d5e722dc784d1d60bc73461deb9ae36cf1c05eb9328040356048bd1ec3ba7bc1
Sep 11 21:29:38.187424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:38.187403    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:29:38.224159 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:38.224129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2" event={"ID":"7849f1fa-1ad4-4774-9d3d-488942e5335b","Type":"ContainerStarted","Data":"d5e722dc784d1d60bc73461deb9ae36cf1c05eb9328040356048bd1ec3ba7bc1"}
Sep 11 21:29:39.045800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:39.045769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:39.232660 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:39.232624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2" event={"ID":"7849f1fa-1ad4-4774-9d3d-488942e5335b","Type":"ContainerStarted","Data":"2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652"}
Sep 11 21:29:39.232852 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:39.232743    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:39.261361 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:39.261305    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2" podStartSLOduration=2.261288337 podStartE2EDuration="2.261288337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:39.258077081 +0000 UTC m=+741.570302447" watchObservedRunningTime="2026-09-11 21:29:39.261288337 +0000 UTC m=+741.573513703"
Sep 11 21:29:40.203826 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.203795    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:29:40.320125 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.320086    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"]
Sep 11 21:29:40.324079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.324051    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.327179 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.327156    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5b37c5b2-serving-cert\""
Sep 11 21:29:40.346665 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.346634    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"]
Sep 11 21:29:40.373793 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.373755    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:40.474932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.474832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-maas-api-tls\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.474932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.474923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-metrics-certs\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.475150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.475049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-openshift-service-ca\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.475150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.475089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgx4r\" (UniqueName: \"kubernetes.io/projected/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-kube-api-access-bgx4r\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.475863 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.475836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:40.576673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.576639    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-openshift-service-ca\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.576673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.576677    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgx4r\" (UniqueName: \"kubernetes.io/projected/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-kube-api-access-bgx4r\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.576928 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.576720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-maas-api-tls\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.576928 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.576769    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-metrics-certs\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.577381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.577358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-openshift-service-ca\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.579154 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.579130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-metrics-certs\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.579273 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.579173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-maas-api-tls\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.587608 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.587584    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgx4r\" (UniqueName: \"kubernetes.io/projected/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-kube-api-access-bgx4r\") pod \"maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.592914 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.592874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:40.635006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.634973    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:40.851337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.851301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:40.921499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:40.921452    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"]
Sep 11 21:29:40.922483 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:40.922456    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb5e5d5_11f5_44e0_91c8_13ee1802d88a.slice/crio-12f066418cb9a2b1808b198918a58af7d8c6683d2ec571dafb98968ebd9cd727 WatchSource:0}: Error finding container 12f066418cb9a2b1808b198918a58af7d8c6683d2ec571dafb98968ebd9cd727: Status 404 returned error can't find the container with id 12f066418cb9a2b1808b198918a58af7d8c6683d2ec571dafb98968ebd9cd727
Sep 11 21:29:41.095026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.094990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:41.220088 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.220004    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:41.247647 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.247612    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4" event={"ID":"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a","Type":"ContainerStarted","Data":"12f066418cb9a2b1808b198918a58af7d8c6683d2ec571dafb98968ebd9cd727"}
Sep 11 21:29:41.328858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.328827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:41.691001 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.690964    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"]
Sep 11 21:29:41.694768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.694745    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:41.698331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.698305    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5b37c5b2\""
Sep 11 21:29:41.699115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.699098    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5b37c5b2-dockercfg-zfk2b\""
Sep 11 21:29:41.720892 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.720856    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"]
Sep 11 21:29:41.788768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.788734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhxq5\" (UniqueName: \"kubernetes.io/projected/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-kube-api-access-mhxq5\") pod \"payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") " pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:41.788938 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.788804    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-plugins-config-volume\") pod \"payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") " pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:41.886289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.886227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:41.896080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.890156    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhxq5\" (UniqueName: \"kubernetes.io/projected/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-kube-api-access-mhxq5\") pod \"payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") " pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:41.896080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.890273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-plugins-config-volume\") pod \"payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") " pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:41.896080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.891144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-plugins-config-volume\") pod \"payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") " pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:41.906932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:41.906906    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhxq5\" (UniqueName: \"kubernetes.io/projected/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-kube-api-access-mhxq5\") pod \"payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") " pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:42.006099 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:42.006067    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:42.255967 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:42.255935    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4" event={"ID":"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a","Type":"ContainerStarted","Data":"a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac"}
Sep 11 21:29:42.256386 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:42.255999    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:42.285056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:42.285004    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4" podStartSLOduration=1.956457879 podStartE2EDuration="2.284988205s" totalImagesPullingTime="328.530326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:42.281602398 +0000 UTC m=+744.593827765" watchObservedRunningTime="2026-09-11 21:29:42.284988205 +0000 UTC m=+744.597213571"
Sep 11 21:29:42.290788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:42.290765    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"]
Sep 11 21:29:42.291284 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:42.291244    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4b11ae_404d_4c44_9f06_0bdedf1acc52.slice/crio-f39b79df991a762432740ee66d74451f73361658c859d22a3a1195c0b53e79fb WatchSource:0}: Error finding container f39b79df991a762432740ee66d74451f73361658c859d22a3a1195c0b53e79fb: Status 404 returned error can't find the container with id f39b79df991a762432740ee66d74451f73361658c859d22a3a1195c0b53e79fb
Sep 11 21:29:43.123131 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:43.123091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:43.265859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:43.265807    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv" event={"ID":"fb4b11ae-404d-4c44-9f06-0bdedf1acc52","Type":"ContainerStarted","Data":"0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a"}
Sep 11 21:29:43.266361 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:43.265874    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv" event={"ID":"fb4b11ae-404d-4c44-9f06-0bdedf1acc52","Type":"ContainerStarted","Data":"f39b79df991a762432740ee66d74451f73361658c859d22a3a1195c0b53e79fb"}
Sep 11 21:29:43.991733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:43.991683    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:44.195093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:44.195043    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:44.273031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:44.272984    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:45.127143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:45.127106    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:45.200206 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:45.200172    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:29:45.239681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:45.239629    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv" podStartSLOduration=4.239612768 podStartE2EDuration="4.239612768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:43.300549059 +0000 UTC m=+745.612774427" watchObservedRunningTime="2026-09-11 21:29:45.239612768 +0000 UTC m=+747.551838134"
Sep 11 21:29:45.400701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:45.400611    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:45.604312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:45.604274    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:45.815676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:45.815640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:46.051463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:46.051427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:46.311454 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:46.311422    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:46.498093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:46.498056    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:46.633224 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:46.633133    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:47.911475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:47.911439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:48.271262 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:48.271224    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:29:49.125522 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:49.125483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:49.882605 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:49.882566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:50.032956 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:50.032923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:50.242803 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:50.242716    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:29:50.460485 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:50.460451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:51.791108 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:51.791069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:52.672745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:52.672695    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:53.609403 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.609363    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"]
Sep 11 21:29:53.616459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.616432    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.619774 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.619747    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-02c60f-serving-cert\""
Sep 11 21:29:53.628758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.628727    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"]
Sep 11 21:29:53.702677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.702638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:53.796915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.796874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:53.812205 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.812131    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.812416 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.812274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvrl\" (UniqueName: \"kubernetes.io/projected/0d4c68bf-076c-4ebc-85d8-af001dec84d5-kube-api-access-jzvrl\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.812416 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.812361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c68bf-076c-4ebc-85d8-af001dec84d5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.812527 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.812437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-metrics-certs\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.913841 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.913750    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-metrics-certs\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.913841 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.913816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.914056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.913875    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvrl\" (UniqueName: \"kubernetes.io/projected/0d4c68bf-076c-4ebc-85d8-af001dec84d5-kube-api-access-jzvrl\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.914056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.913923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c68bf-076c-4ebc-85d8-af001dec84d5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.914056 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:53.913979    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-serving-cert: secret "maas-api-e2e-inf-b-02c60f-serving-cert" not found
Sep 11 21:29:53.914212 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:29:53.914061    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls podName:0d4c68bf-076c-4ebc-85d8-af001dec84d5 nodeName:}" failed. No retries permitted until 2026-09-11 21:29:54.414039634 +0000 UTC m=+756.726264980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls") pod "maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" (UID: "0d4c68bf-076c-4ebc-85d8-af001dec84d5") : secret "maas-api-e2e-inf-b-02c60f-serving-cert" not found
Sep 11 21:29:53.914622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.914603    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c68bf-076c-4ebc-85d8-af001dec84d5-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.916201 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.916182    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-metrics-certs\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:53.923741 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:53.923712    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvrl\" (UniqueName: \"kubernetes.io/projected/0d4c68bf-076c-4ebc-85d8-af001dec84d5-kube-api-access-jzvrl\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:54.147548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.147517    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:54.258270 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.258211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:54.360584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.360542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:54.419906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.419866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:54.422323 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.422301    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls\") pod \"maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:54.530402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.530318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:54.617749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.617708    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:54.742475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.742437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:54.813973 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:54.813947    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"]
Sep 11 21:29:54.814910 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:29:54.814887    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4c68bf_076c_4ebc_85d8_af001dec84d5.slice/crio-e13bb1c4ab6d70b92c2870f443671a510abe593fa8633f1b6ccaa9f155817da4 WatchSource:0}: Error finding container e13bb1c4ab6d70b92c2870f443671a510abe593fa8633f1b6ccaa9f155817da4: Status 404 returned error can't find the container with id e13bb1c4ab6d70b92c2870f443671a510abe593fa8633f1b6ccaa9f155817da4
Sep 11 21:29:55.282492 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:55.282455    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:29:55.347732 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:55.347697    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" event={"ID":"0d4c68bf-076c-4ebc-85d8-af001dec84d5","Type":"ContainerStarted","Data":"e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441"}
Sep 11 21:29:55.347903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:55.347763    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:29:55.347903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:55.347786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" event={"ID":"0d4c68bf-076c-4ebc-85d8-af001dec84d5","Type":"ContainerStarted","Data":"e13bb1c4ab6d70b92c2870f443671a510abe593fa8633f1b6ccaa9f155817da4"}
Sep 11 21:29:55.373905 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:55.373850    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" podStartSLOduration=2.046994698 podStartE2EDuration="2.37383196s" totalImagesPullingTime="326.837262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:29:55.371358974 +0000 UTC m=+757.683584344" watchObservedRunningTime="2026-09-11 21:29:55.37383196 +0000 UTC m=+757.686057327"
Sep 11 21:29:55.726658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:55.726619    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:56.512736 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:56.512702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:57.520612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:57.520568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:58.407650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:58.407574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:59.229380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:29:59.229348    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:00.146722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:00.146685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:01.359715 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:01.359687    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:30:01.841446 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:01.841409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:03.997837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:03.997804    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"]
Sep 11 21:30:03.998297 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:03.998019    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4" podUID="4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" containerName="maas-api" containerID="cri-o://a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac" gracePeriod=30
Sep 11 21:30:04.035960 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.035927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:04.104380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.104346    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"]
Sep 11 21:30:04.104667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.104602    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv" podUID="fb4b11ae-404d-4c44-9f06-0bdedf1acc52" containerName="payload-processing" containerID="cri-o://0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a" gracePeriod=30
Sep 11 21:30:04.156977 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.156930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:04.256082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.256006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:04.259719 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.259696    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:30:04.325390 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.325362    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgx4r\" (UniqueName: \"kubernetes.io/projected/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-kube-api-access-bgx4r\") pod \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") "
Sep 11 21:30:04.325577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.325425    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-metrics-certs\") pod \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") "
Sep 11 21:30:04.325577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.325459    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-openshift-service-ca\") pod \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") "
Sep 11 21:30:04.325577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.325480    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-maas-api-tls\") pod \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\" (UID: \"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a\") "
Sep 11 21:30:04.325968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.325864    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" (UID: "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:30:04.327806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.327783    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-kube-api-access-bgx4r" (OuterVolumeSpecName: "kube-api-access-bgx4r") pod "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" (UID: "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a"). InnerVolumeSpecName "kube-api-access-bgx4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:30:04.328033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.328014    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" (UID: "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:30:04.328184 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.328160    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" (UID: "4cb5e5d5-11f5-44e0-91c8-13ee1802d88a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:30:04.357442 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.357411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:04.367814 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.367792    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:30:04.404830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.404799    2572 generic.go:356] "Generic (PLEG): container finished" podID="fb4b11ae-404d-4c44-9f06-0bdedf1acc52" containerID="0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a" exitCode=0
Sep 11 21:30:04.405024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.404843    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"
Sep 11 21:30:04.405024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.404882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv" event={"ID":"fb4b11ae-404d-4c44-9f06-0bdedf1acc52","Type":"ContainerDied","Data":"0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a"}
Sep 11 21:30:04.405024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.404937    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv" event={"ID":"fb4b11ae-404d-4c44-9f06-0bdedf1acc52","Type":"ContainerDied","Data":"f39b79df991a762432740ee66d74451f73361658c859d22a3a1195c0b53e79fb"}
Sep 11 21:30:04.405024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.404964    2572 scope.go:117] "RemoveContainer" containerID="0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a"
Sep 11 21:30:04.406580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.406555    2572 generic.go:356] "Generic (PLEG): container finished" podID="4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" containerID="a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac" exitCode=0
Sep 11 21:30:04.406718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.406595    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"
Sep 11 21:30:04.406718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.406592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4" event={"ID":"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a","Type":"ContainerDied","Data":"a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac"}
Sep 11 21:30:04.406811 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.406733    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4" event={"ID":"4cb5e5d5-11f5-44e0-91c8-13ee1802d88a","Type":"ContainerDied","Data":"12f066418cb9a2b1808b198918a58af7d8c6683d2ec571dafb98968ebd9cd727"}
Sep 11 21:30:04.421875 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.421846    2572 scope.go:117] "RemoveContainer" containerID="0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a"
Sep 11 21:30:04.422278 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:30:04.422246    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a\": container with ID starting with 0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a not found: ID does not exist" containerID="0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a"
Sep 11 21:30:04.422372 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.422287    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a"} err="failed to get container status \"0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a\": rpc error: code = NotFound desc = could not find container \"0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a\": container with ID starting with 0928abd0bf91946abbb604fee903d0e1d40ef5baf2d6221bbdd5ec62bbaba42a not found: ID does not exist"
Sep 11 21:30:04.422372 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.422307    2572 scope.go:117] "RemoveContainer" containerID="a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac"
Sep 11 21:30:04.426867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.426811    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-plugins-config-volume\") pod \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") "
Sep 11 21:30:04.426867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.426863    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhxq5\" (UniqueName: \"kubernetes.io/projected/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-kube-api-access-mhxq5\") pod \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\" (UID: \"fb4b11ae-404d-4c44-9f06-0bdedf1acc52\") "
Sep 11 21:30:04.427183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.427163    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgx4r\" (UniqueName: \"kubernetes.io/projected/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-kube-api-access-bgx4r\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.427223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.427188    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.427223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.427204    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.427223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.427203    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb4b11ae-404d-4c44-9f06-0bdedf1acc52" (UID: "fb4b11ae-404d-4c44-9f06-0bdedf1acc52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:30:04.427223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.427218    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.429018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.428991    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-kube-api-access-mhxq5" (OuterVolumeSpecName: "kube-api-access-mhxq5") pod "fb4b11ae-404d-4c44-9f06-0bdedf1acc52" (UID: "fb4b11ae-404d-4c44-9f06-0bdedf1acc52"). InnerVolumeSpecName "kube-api-access-mhxq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:30:04.431717 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.431698    2572 scope.go:117] "RemoveContainer" containerID="a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac"
Sep 11 21:30:04.432026 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:30:04.432010    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac\": container with ID starting with a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac not found: ID does not exist" containerID="a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac"
Sep 11 21:30:04.432093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.432035    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac"} err="failed to get container status \"a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac\": rpc error: code = NotFound desc = could not find container \"a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac\": container with ID starting with a79b92f54ed564d7dc45a8e4ab41d600b06d595de5bc72e2b20f78d886f452ac not found: ID does not exist"
Sep 11 21:30:04.434577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.434557    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"]
Sep 11 21:30:04.439195 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.439177    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b37c5b2-b7f7496db-flfj4"]
Sep 11 21:30:04.447674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.447653    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:04.527853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.527772    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhxq5\" (UniqueName: \"kubernetes.io/projected/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-kube-api-access-mhxq5\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.527853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.527803    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb4b11ae-404d-4c44-9f06-0bdedf1acc52-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:04.536813 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.536777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:04.729277 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.729238    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"]
Sep 11 21:30:04.735909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.735882    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b37c5b2-7479bf4469-tkrrv"]
Sep 11 21:30:04.800650 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:04.800571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:05.040873 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:05.040835    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:05.133607 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:05.133520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:05.236961 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:05.236908    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:05.618718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:05.618682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:05.780602 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:05.780510    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:06.144141 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:06.144108    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" path="/var/lib/kubelet/pods/4cb5e5d5-11f5-44e0-91c8-13ee1802d88a/volumes"
Sep 11 21:30:06.144552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:06.144492    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb4b11ae-404d-4c44-9f06-0bdedf1acc52" path="/var/lib/kubelet/pods/fb4b11ae-404d-4c44-9f06-0bdedf1acc52/volumes"
Sep 11 21:30:06.742040 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:06.742004    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:06.847773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:06.847731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:07.421603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:07.421563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:07.518916 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:07.518879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:07.687312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:07.687208    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:07.889803 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:07.889761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:08.360520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:08.360471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:08.462141 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:08.462105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:08.992989 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:08.992944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:09.545476 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:09.545445    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:09.895030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:09.894929    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:11.159594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:11.159559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:12.282170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:12.282134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:13.328310 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:13.328245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:13.429895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:13.429862    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:13.892380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:13.892343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:14.003631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.003592    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:14.017531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.017502    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"]
Sep 11 21:30:14.018022 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.018009    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" containerName="maas-api"
Sep 11 21:30:14.018070 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.018027    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" containerName="maas-api"
Sep 11 21:30:14.018070 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.018040    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4b11ae-404d-4c44-9f06-0bdedf1acc52" containerName="payload-processing"
Sep 11 21:30:14.018070 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.018046    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4b11ae-404d-4c44-9f06-0bdedf1acc52" containerName="payload-processing"
Sep 11 21:30:14.018163 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.018127    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4b11ae-404d-4c44-9f06-0bdedf1acc52" containerName="payload-processing"
Sep 11 21:30:14.018163 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.018139    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cb5e5d5-11f5-44e0-91c8-13ee1802d88a" containerName="maas-api"
Sep 11 21:30:14.021396 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.021377    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.024100 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.024078    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d3e394ce\""
Sep 11 21:30:14.024309 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.024289    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d3e394ce-dockercfg-rzk7m\""
Sep 11 21:30:14.041026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.040988    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"]
Sep 11 21:30:14.124634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.124597    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:14.125084 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.125060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njnmh\" (UniqueName: \"kubernetes.io/projected/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-kube-api-access-njnmh\") pod \"payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") " pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.125192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.125166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") " pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.226014 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.225920    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njnmh\" (UniqueName: \"kubernetes.io/projected/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-kube-api-access-njnmh\") pod \"payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") " pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.226243 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.226025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") " pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.226824 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.226798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") " pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.235866 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.235841    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njnmh\" (UniqueName: \"kubernetes.io/projected/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-kube-api-access-njnmh\") pod \"payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") " pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.332091 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.332053    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:14.347889 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.347845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:14.610101 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.610073    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"]
Sep 11 21:30:14.610723 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:30:14.610694    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956be4a8_eae9_4a66_a8d0_46fe4ac7d424.slice/crio-dba7d25c67dd1d0ea7e8ffc3be02549abff0985bd9bcacedf0ff78ffd87fb27c WatchSource:0}: Error finding container dba7d25c67dd1d0ea7e8ffc3be02549abff0985bd9bcacedf0ff78ffd87fb27c: Status 404 returned error can't find the container with id dba7d25c67dd1d0ea7e8ffc3be02549abff0985bd9bcacedf0ff78ffd87fb27c
Sep 11 21:30:14.979530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:14.979446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:15.082034 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.081987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:15.191648 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.191608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:15.291681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.291649    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:15.393687 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.393654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:15.488481 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.488444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd" event={"ID":"956be4a8-eae9-4a66-a8d0-46fe4ac7d424","Type":"ContainerStarted","Data":"08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5"}
Sep 11 21:30:15.488687 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.488504    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd" event={"ID":"956be4a8-eae9-4a66-a8d0-46fe4ac7d424","Type":"ContainerStarted","Data":"dba7d25c67dd1d0ea7e8ffc3be02549abff0985bd9bcacedf0ff78ffd87fb27c"}
Sep 11 21:30:15.488687 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.488536    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:15.510915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:15.510864    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd" podStartSLOduration=2.510848646 podStartE2EDuration="2.510848646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:15.508522193 +0000 UTC m=+777.820747560" watchObservedRunningTime="2026-09-11 21:30:15.510848646 +0000 UTC m=+777.823074038"
Sep 11 21:30:16.206696 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:16.206657    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:22.179622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:22.179586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:22.400083 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:22.400045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:26.497094 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:26.497060    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:34.336449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:34.336406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:35.885100 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:35.885063    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:36.803402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:36.803366    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:37.579288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:37.579242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:38.389634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:38.389598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:39.528681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:39.528633    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:40.320246 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:40.320201    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:41.186447 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:41.186394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:42.230784 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:42.230747    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:43.087858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:43.087820    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:44.021672 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:44.021625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:44.891113 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:44.891076    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:49.572509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:49.572471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.394116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.394072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.445991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.445952    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"]
Sep 11 21:30:50.446237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.446211    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd" podUID="956be4a8-eae9-4a66-a8d0-46fe4ac7d424" containerName="payload-processing" containerID="cri-o://08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5" gracePeriod=30
Sep 11 21:30:50.496375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.496337    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.506928 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:30:50.506888    2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956be4a8_eae9_4a66_a8d0_46fe4ac7d424.slice/crio-08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956be4a8_eae9_4a66_a8d0_46fe4ac7d424.slice/crio-conmon-08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 21:30:50.619067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.619032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.697427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.697403    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:50.705046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.705017    2572 generic.go:356] "Generic (PLEG): container finished" podID="956be4a8-eae9-4a66-a8d0-46fe4ac7d424" containerID="08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5" exitCode=0
Sep 11 21:30:50.705197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.705059    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"
Sep 11 21:30:50.705197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.705095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd" event={"ID":"956be4a8-eae9-4a66-a8d0-46fe4ac7d424","Type":"ContainerDied","Data":"08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5"}
Sep 11 21:30:50.705197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.705147    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd" event={"ID":"956be4a8-eae9-4a66-a8d0-46fe4ac7d424","Type":"ContainerDied","Data":"dba7d25c67dd1d0ea7e8ffc3be02549abff0985bd9bcacedf0ff78ffd87fb27c"}
Sep 11 21:30:50.705197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.705171    2572 scope.go:117] "RemoveContainer" containerID="08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5"
Sep 11 21:30:50.716837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.716817    2572 scope.go:117] "RemoveContainer" containerID="08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5"
Sep 11 21:30:50.717123 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:30:50.717105    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5\": container with ID starting with 08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5 not found: ID does not exist" containerID="08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5"
Sep 11 21:30:50.717186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.717133    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5"} err="failed to get container status \"08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5\": rpc error: code = NotFound desc = could not find container \"08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5\": container with ID starting with 08056e6173a05c214ab6304a68eff206cff143ec45604bcdb1213bff587347c5 not found: ID does not exist"
Sep 11 21:30:50.753893 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.753854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.791319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.791261    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-plugins-config-volume\") pod \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") "
Sep 11 21:30:50.791578 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.791416    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njnmh\" (UniqueName: \"kubernetes.io/projected/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-kube-api-access-njnmh\") pod \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\" (UID: \"956be4a8-eae9-4a66-a8d0-46fe4ac7d424\") "
Sep 11 21:30:50.791704 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.791676    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "956be4a8-eae9-4a66-a8d0-46fe4ac7d424" (UID: "956be4a8-eae9-4a66-a8d0-46fe4ac7d424"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:30:50.792304 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.792277    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:50.793718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.793691    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-kube-api-access-njnmh" (OuterVolumeSpecName: "kube-api-access-njnmh") pod "956be4a8-eae9-4a66-a8d0-46fe4ac7d424" (UID: "956be4a8-eae9-4a66-a8d0-46fe4ac7d424"). InnerVolumeSpecName "kube-api-access-njnmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:30:50.865477 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.865437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.893365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:50.893332    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njnmh\" (UniqueName: \"kubernetes.io/projected/956be4a8-eae9-4a66-a8d0-46fe4ac7d424-kube-api-access-njnmh\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:30:51.005652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:51.005616    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:51.036387 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:51.036357    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"]
Sep 11 21:30:51.041872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:51.041845    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d3e394ce-68d8d987db-glxxd"]
Sep 11 21:30:51.206290 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:51.206225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:51.438289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:51.438175    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:51.847018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:51.846976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:52.062489 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:52.062452    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:52.144147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:52.144070    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956be4a8-eae9-4a66-a8d0-46fe4ac7d424" path="/var/lib/kubelet/pods/956be4a8-eae9-4a66-a8d0-46fe4ac7d424/volumes"
Sep 11 21:30:52.237698 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:52.237667    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:52.667983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:52.667936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:53.936427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:53.936390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:54.269990 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:54.269952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:54.414756 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:54.414717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:55.329792 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:55.329759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:56.417155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:56.417122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:57.587652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:57.587614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:58.968409 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:58.968378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:59.082783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.082745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:59.642787 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.642735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:59.751065 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.751022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:59.755036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.755010    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"]
Sep 11 21:30:59.755510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.755496    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956be4a8-eae9-4a66-a8d0-46fe4ac7d424" containerName="payload-processing"
Sep 11 21:30:59.755562 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.755512    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="956be4a8-eae9-4a66-a8d0-46fe4ac7d424" containerName="payload-processing"
Sep 11 21:30:59.755608 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.755599    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="956be4a8-eae9-4a66-a8d0-46fe4ac7d424" containerName="payload-processing"
Sep 11 21:30:59.758975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.758952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:30:59.761866 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.761841    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b0bde17e\""
Sep 11 21:30:59.779408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.779382    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"]
Sep 11 21:30:59.837050 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.837016    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"]
Sep 11 21:30:59.839881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.839864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:30:59.843572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.843549    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b0bde17e-dockercfg-bgwdk\""
Sep 11 21:30:59.862854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.862834    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"]
Sep 11 21:30:59.886026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.885998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hm9\" (UniqueName: \"kubernetes.io/projected/efc8e08e-4a48-4198-8f9a-cc51f661bec1-kube-api-access-v2hm9\") pod \"payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") " pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:30:59.886200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.886178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc8e08e-4a48-4198-8f9a-cc51f661bec1-plugins-config-volume\") pod \"payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") " pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:30:59.986883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.986812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc8e08e-4a48-4198-8f9a-cc51f661bec1-plugins-config-volume\") pod \"payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") " pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:30:59.986883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.986862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hm9\" (UniqueName: \"kubernetes.io/projected/efc8e08e-4a48-4198-8f9a-cc51f661bec1-kube-api-access-v2hm9\") pod \"payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") " pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:30:59.987337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.986913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjkxb\" (UniqueName: \"kubernetes.io/projected/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-kube-api-access-xjkxb\") pod \"payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:30:59.987337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.986965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:30:59.987587 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.987565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc8e08e-4a48-4198-8f9a-cc51f661bec1-plugins-config-volume\") pod \"payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") " pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:30:59.999341 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:30:59.999316    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hm9\" (UniqueName: \"kubernetes.io/projected/efc8e08e-4a48-4198-8f9a-cc51f661bec1-kube-api-access-v2hm9\") pod \"payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") " pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:31:00.070974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.070941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:31:00.088618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.088583    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjkxb\" (UniqueName: \"kubernetes.io/projected/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-kube-api-access-xjkxb\") pod \"payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:00.088878 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.088850    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:00.089745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.089716    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:00.098434 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.098391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjkxb\" (UniqueName: \"kubernetes.io/projected/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-kube-api-access-xjkxb\") pod \"payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:00.149897 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.149806    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:00.181700 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.181636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:00.366685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.366655    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"]
Sep 11 21:31:00.366880 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:31:00.366842    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc8e08e_4a48_4198_8f9a_cc51f661bec1.slice/crio-03cd0044c0302ed149d6a118d294d2638a41c4e35037fa3df82f6882c7458386 WatchSource:0}: Error finding container 03cd0044c0302ed149d6a118d294d2638a41c4e35037fa3df82f6882c7458386: Status 404 returned error can't find the container with id 03cd0044c0302ed149d6a118d294d2638a41c4e35037fa3df82f6882c7458386
Sep 11 21:31:00.443804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.443778    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"]
Sep 11 21:31:00.444109 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:31:00.444087    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2e2f1c_bbda_4c1a_8bf9_d70f8f56fae4.slice/crio-8f15c0873fde3b9a38461281711f6983fe7e30aa1ab63b768ade8dcde57e82c1 WatchSource:0}: Error finding container 8f15c0873fde3b9a38461281711f6983fe7e30aa1ab63b768ade8dcde57e82c1: Status 404 returned error can't find the container with id 8f15c0873fde3b9a38461281711f6983fe7e30aa1ab63b768ade8dcde57e82c1
Sep 11 21:31:00.771648 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.771608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp" event={"ID":"efc8e08e-4a48-4198-8f9a-cc51f661bec1","Type":"ContainerStarted","Data":"9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893"}
Sep 11 21:31:00.771851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.771682    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:31:00.771851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.771704    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp" event={"ID":"efc8e08e-4a48-4198-8f9a-cc51f661bec1","Type":"ContainerStarted","Data":"03cd0044c0302ed149d6a118d294d2638a41c4e35037fa3df82f6882c7458386"}
Sep 11 21:31:00.773303 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.773278    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk" event={"ID":"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4","Type":"ContainerStarted","Data":"19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc"}
Sep 11 21:31:00.773404 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.773327    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk" event={"ID":"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4","Type":"ContainerStarted","Data":"8f15c0873fde3b9a38461281711f6983fe7e30aa1ab63b768ade8dcde57e82c1"}
Sep 11 21:31:00.773404 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.773363    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:00.797968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.797918    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp" podStartSLOduration=1.797904281 podStartE2EDuration="1.797904281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:00.795680909 +0000 UTC m=+823.107906276" watchObservedRunningTime="2026-09-11 21:31:00.797904281 +0000 UTC m=+823.110129647"
Sep 11 21:31:00.830125 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:00.830063    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk" podStartSLOduration=1.8300396920000002 podStartE2EDuration="1.830039692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:00.827946186 +0000 UTC m=+823.140171552" watchObservedRunningTime="2026-09-11 21:31:00.830039692 +0000 UTC m=+823.142265062"
Sep 11 21:31:01.477209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:01.477162    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:02.748530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:02.748495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:07.407011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:07.406970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:11.780421 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:11.780387    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:11.780964 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:11.780522    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:31:13.289806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:13.289765    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:15.192084 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:15.192050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:21.613511 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:21.613468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:22.521710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:22.521673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:23.547598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:23.547560    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:24.516644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:24.516605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:25.766459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:25.766423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:27.089965 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:27.089927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:28.133010 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:28.132973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:29.021142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:29.021101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:30.036899 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:30.036865    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:30.844572 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:30.844542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:31.896332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:31.896297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:32.662337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:32.662298    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:32.946951 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:32.946858    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:35.783899 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:35.783865    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.454357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.454322    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.483195 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.483156    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"]
Sep 11 21:31:36.483465 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.483431    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp" podUID="efc8e08e-4a48-4198-8f9a-cc51f661bec1" containerName="payload-processing" containerID="cri-o://9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893" gracePeriod=30
Sep 11 21:31:36.493832 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.493798    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"]
Sep 11 21:31:36.494066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.494039    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk" podUID="9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" containerName="payload-pre-processing" containerID="cri-o://19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc" gracePeriod=30
Sep 11 21:31:36.533356 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.533319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.605397 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.605360    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.687680 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.687643    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.780513 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.780486    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:31:36.791487 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.791455    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:36.939000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.938961    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-plugins-config-volume\") pod \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") "
Sep 11 21:31:36.939202 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.939012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc8e08e-4a48-4198-8f9a-cc51f661bec1-plugins-config-volume\") pod \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") "
Sep 11 21:31:36.939202 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.939040    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjkxb\" (UniqueName: \"kubernetes.io/projected/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-kube-api-access-xjkxb\") pod \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\" (UID: \"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4\") "
Sep 11 21:31:36.939202 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.939123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2hm9\" (UniqueName: \"kubernetes.io/projected/efc8e08e-4a48-4198-8f9a-cc51f661bec1-kube-api-access-v2hm9\") pod \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\" (UID: \"efc8e08e-4a48-4198-8f9a-cc51f661bec1\") "
Sep 11 21:31:36.939569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.939541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" (UID: "9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:36.939637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.939583    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc8e08e-4a48-4198-8f9a-cc51f661bec1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efc8e08e-4a48-4198-8f9a-cc51f661bec1" (UID: "efc8e08e-4a48-4198-8f9a-cc51f661bec1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:36.941181 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.941160    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-kube-api-access-xjkxb" (OuterVolumeSpecName: "kube-api-access-xjkxb") pod "9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" (UID: "9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4"). InnerVolumeSpecName "kube-api-access-xjkxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:36.941234 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:36.941169    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc8e08e-4a48-4198-8f9a-cc51f661bec1-kube-api-access-v2hm9" (OuterVolumeSpecName: "kube-api-access-v2hm9") pod "efc8e08e-4a48-4198-8f9a-cc51f661bec1" (UID: "efc8e08e-4a48-4198-8f9a-cc51f661bec1"). InnerVolumeSpecName "kube-api-access-v2hm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:37.006376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.006279    2572 generic.go:356] "Generic (PLEG): container finished" podID="efc8e08e-4a48-4198-8f9a-cc51f661bec1" containerID="9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893" exitCode=0
Sep 11 21:31:37.006376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.006327    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"
Sep 11 21:31:37.006615 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.006369    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp" event={"ID":"efc8e08e-4a48-4198-8f9a-cc51f661bec1","Type":"ContainerDied","Data":"9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893"}
Sep 11 21:31:37.006615 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.006432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp" event={"ID":"efc8e08e-4a48-4198-8f9a-cc51f661bec1","Type":"ContainerDied","Data":"03cd0044c0302ed149d6a118d294d2638a41c4e35037fa3df82f6882c7458386"}
Sep 11 21:31:37.006615 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.006461    2572 scope.go:117] "RemoveContainer" containerID="9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893"
Sep 11 21:31:37.008054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.007848    2572 generic.go:356] "Generic (PLEG): container finished" podID="9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" containerID="19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc" exitCode=0
Sep 11 21:31:37.008054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.007890    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"
Sep 11 21:31:37.008054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.007923    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk" event={"ID":"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4","Type":"ContainerDied","Data":"19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc"}
Sep 11 21:31:37.008054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.007975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk" event={"ID":"9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4","Type":"ContainerDied","Data":"8f15c0873fde3b9a38461281711f6983fe7e30aa1ab63b768ade8dcde57e82c1"}
Sep 11 21:31:37.018790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.018764    2572 scope.go:117] "RemoveContainer" containerID="9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893"
Sep 11 21:31:37.019114 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:31:37.019093    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893\": container with ID starting with 9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893 not found: ID does not exist" containerID="9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893"
Sep 11 21:31:37.019200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.019124    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893"} err="failed to get container status \"9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893\": rpc error: code = NotFound desc = could not find container \"9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893\": container with ID starting with 9bada7c4e0f63a0183c82deee008217b7b327d012ca5a4a173048ca0aeb25893 not found: ID does not exist"
Sep 11 21:31:37.019200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.019143    2572 scope.go:117] "RemoveContainer" containerID="19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc"
Sep 11 21:31:37.031357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.031336    2572 scope.go:117] "RemoveContainer" containerID="19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc"
Sep 11 21:31:37.031742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.031717    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"]
Sep 11 21:31:37.032152 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:31:37.031870    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc\": container with ID starting with 19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc not found: ID does not exist" containerID="19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc"
Sep 11 21:31:37.032152 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.031929    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc"} err="failed to get container status \"19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc\": rpc error: code = NotFound desc = could not find container \"19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc\": container with ID starting with 19ab5560928f894924d3ced6f11602f36247d90c04400dd2b3b438702dd50fcc not found: ID does not exist"
Sep 11 21:31:37.035413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.035392    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b0bde17e-84cdfc8c7f-66mmp"]
Sep 11 21:31:37.039906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.039881    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2hm9\" (UniqueName: \"kubernetes.io/projected/efc8e08e-4a48-4198-8f9a-cc51f661bec1-kube-api-access-v2hm9\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:31:37.039906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.039904    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:31:37.040058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.039915    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efc8e08e-4a48-4198-8f9a-cc51f661bec1-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:31:37.040058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.039924    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjkxb\" (UniqueName: \"kubernetes.io/projected/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4-kube-api-access-xjkxb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:31:37.048042 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.048013    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"]
Sep 11 21:31:37.051160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.051139    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b0bde17e-7986c96954-h5rwk"]
Sep 11 21:31:37.112139 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.112058    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:37.874740 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:37.874629    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:38.040461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:38.040427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:38.143731 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:38.143652    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" path="/var/lib/kubelet/pods/9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4/volumes"
Sep 11 21:31:38.144028 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:38.144014    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc8e08e-4a48-4198-8f9a-cc51f661bec1" path="/var/lib/kubelet/pods/efc8e08e-4a48-4198-8f9a-cc51f661bec1/volumes"
Sep 11 21:31:38.372056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:38.372019    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:38.685415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:38.685377    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:39.117060 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:39.117013    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:39.381381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:39.381278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:39.879503 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:39.879470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:40.733894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:40.733863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:41.419147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:41.419103    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:41.560972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:41.560939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:42.270983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:42.270949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:43.173290 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.173231    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"]
Sep 11 21:31:43.173855 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.173836    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" containerName="payload-pre-processing"
Sep 11 21:31:43.173952 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.173858    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" containerName="payload-pre-processing"
Sep 11 21:31:43.173952 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.173898    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc8e08e-4a48-4198-8f9a-cc51f661bec1" containerName="payload-processing"
Sep 11 21:31:43.173952 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.173908    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc8e08e-4a48-4198-8f9a-cc51f661bec1" containerName="payload-processing"
Sep 11 21:31:43.174102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.174036    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2e2f1c-bbda-4c1a-8bf9-d70f8f56fae4" containerName="payload-pre-processing"
Sep 11 21:31:43.174102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.174051    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc8e08e-4a48-4198-8f9a-cc51f661bec1" containerName="payload-processing"
Sep 11 21:31:43.178749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.178727    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.181933 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.181909    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0cd86cdc-serving-cert\""
Sep 11 21:31:43.195501 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.195477    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"]
Sep 11 21:31:43.241400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.241364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:43.306799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.306765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/143789c7-f204-4058-8b5a-6a844edcf48f-kube-api-access-9jd2c\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.307199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.306823    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/143789c7-f204-4058-8b5a-6a844edcf48f-openshift-service-ca\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.307199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.306879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.307199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.307017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-metrics-certs\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.339493 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.339432    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:43.407635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.407596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-metrics-certs\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.407833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.407671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/143789c7-f204-4058-8b5a-6a844edcf48f-kube-api-access-9jd2c\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.407833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.407724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/143789c7-f204-4058-8b5a-6a844edcf48f-openshift-service-ca\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.407833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.407754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.408000 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:31:43.407901    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-serving-cert: secret "maas-api-e2e-derive-0cd86cdc-serving-cert" not found
Sep 11 21:31:43.408000 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:31:43.407992    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls podName:143789c7-f204-4058-8b5a-6a844edcf48f nodeName:}" failed. No retries permitted until 2026-09-11 21:31:43.907968695 +0000 UTC m=+866.220194057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls") pod "maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" (UID: "143789c7-f204-4058-8b5a-6a844edcf48f") : secret "maas-api-e2e-derive-0cd86cdc-serving-cert" not found
Sep 11 21:31:43.408516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.408496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/143789c7-f204-4058-8b5a-6a844edcf48f-openshift-service-ca\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.410110 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.410091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-metrics-certs\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.421340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.421312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/143789c7-f204-4058-8b5a-6a844edcf48f-kube-api-access-9jd2c\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.496845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.496806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:43.888493 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.888393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:43.913607 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.913569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.916045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.916014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls\") pod \"maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:43.984364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:43.984330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:44.071617 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.071578    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"]
Sep 11 21:31:44.075476 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.075455    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.079676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.079648    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0cd86cdc\""
Sep 11 21:31:44.080160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.080139    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0cd86cdc-dockercfg-jl8tg\""
Sep 11 21:31:44.090723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.090699    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:44.091760 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.091738    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"]
Sep 11 21:31:44.217183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.217149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15234ad0-c9a0-4a39-bf91-d08adddaa32e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.217388 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.217213    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lhq\" (UniqueName: \"kubernetes.io/projected/15234ad0-c9a0-4a39-bf91-d08adddaa32e-kube-api-access-f8lhq\") pod \"payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.317939 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.317902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lhq\" (UniqueName: \"kubernetes.io/projected/15234ad0-c9a0-4a39-bf91-d08adddaa32e-kube-api-access-f8lhq\") pod \"payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.318408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.318030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15234ad0-c9a0-4a39-bf91-d08adddaa32e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.318753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.318726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15234ad0-c9a0-4a39-bf91-d08adddaa32e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.328770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.328748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lhq\" (UniqueName: \"kubernetes.io/projected/15234ad0-c9a0-4a39-bf91-d08adddaa32e-kube-api-access-f8lhq\") pod \"payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.362965 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.362932    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:44.373788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.373763    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"]
Sep 11 21:31:44.375480 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:31:44.375455    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143789c7_f204_4058_8b5a_6a844edcf48f.slice/crio-cbff6520b46b2912ba5d805dfa0aed5f596bf14617ad852511f1c0b00c1e9d8d WatchSource:0}: Error finding container cbff6520b46b2912ba5d805dfa0aed5f596bf14617ad852511f1c0b00c1e9d8d: Status 404 returned error can't find the container with id cbff6520b46b2912ba5d805dfa0aed5f596bf14617ad852511f1c0b00c1e9d8d
Sep 11 21:31:44.387460 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.387439    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:44.665974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:44.665946    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"]
Sep 11 21:31:44.667447 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:31:44.667414    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15234ad0_c9a0_4a39_bf91_d08adddaa32e.slice/crio-8165c918e77df74e848ce6cb07f73957867b8e30b23e68d4be69df0be606e00c WatchSource:0}: Error finding container 8165c918e77df74e848ce6cb07f73957867b8e30b23e68d4be69df0be606e00c: Status 404 returned error can't find the container with id 8165c918e77df74e848ce6cb07f73957867b8e30b23e68d4be69df0be606e00c
Sep 11 21:31:45.062068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.062031    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw" event={"ID":"15234ad0-c9a0-4a39-bf91-d08adddaa32e","Type":"ContainerStarted","Data":"e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01"}
Sep 11 21:31:45.062289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.062082    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw" event={"ID":"15234ad0-c9a0-4a39-bf91-d08adddaa32e","Type":"ContainerStarted","Data":"8165c918e77df74e848ce6cb07f73957867b8e30b23e68d4be69df0be606e00c"}
Sep 11 21:31:45.062289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.062112    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:45.063590 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.063567    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" event={"ID":"143789c7-f204-4058-8b5a-6a844edcf48f","Type":"ContainerStarted","Data":"d3ed7f1bf9ba49b2753bad43f6eb954eaa7e06a78d579ef354f999c9054e78c5"}
Sep 11 21:31:45.063685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.063605    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" event={"ID":"143789c7-f204-4058-8b5a-6a844edcf48f","Type":"ContainerStarted","Data":"cbff6520b46b2912ba5d805dfa0aed5f596bf14617ad852511f1c0b00c1e9d8d"}
Sep 11 21:31:45.063685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.063634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:45.084278 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.084206    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw" podStartSLOduration=1.084190737 podStartE2EDuration="1.084190737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:45.080840602 +0000 UTC m=+867.393065967" watchObservedRunningTime="2026-09-11 21:31:45.084190737 +0000 UTC m=+867.396416103"
Sep 11 21:31:45.102976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.102928    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" podStartSLOduration=1.6635172219999999 podStartE2EDuration="2.102907347s" totalImagesPullingTime="439.390125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:45.099713133 +0000 UTC m=+867.411938502" watchObservedRunningTime="2026-09-11 21:31:45.102907347 +0000 UTC m=+867.415132714"
Sep 11 21:31:45.383209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:45.383114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:46.108371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:46.108332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:47.017894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:47.017859    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:47.855055 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:47.855000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:48.985058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:48.985016    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:49.740476 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:49.740433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:50.505697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:50.505661    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:51.075491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:51.075461    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:31:51.446127 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:51.446017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:52.330411 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:52.330351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:53.317162 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:53.317124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:54.203722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:54.203686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:55.209167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:55.209134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:56.071637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:56.071607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:31:59.243998 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.243955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:59.301483 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.301439    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"]
Sep 11 21:31:59.301736 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.301705    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2" podUID="7849f1fa-1ad4-4774-9d3d-488942e5335b" containerName="payload-pre-processing" containerID="cri-o://2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652" gracePeriod=30
Sep 11 21:31:59.347119 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.347080    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:59.446791 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.446752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:59.522168 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.522130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:59.560019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.559995    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:31:59.663930 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.663896    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7849f1fa-1ad4-4774-9d3d-488942e5335b-plugins-config-volume\") pod \"7849f1fa-1ad4-4774-9d3d-488942e5335b\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") "
Sep 11 21:31:59.664124 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.663950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2xwt\" (UniqueName: \"kubernetes.io/projected/7849f1fa-1ad4-4774-9d3d-488942e5335b-kube-api-access-n2xwt\") pod \"7849f1fa-1ad4-4774-9d3d-488942e5335b\" (UID: \"7849f1fa-1ad4-4774-9d3d-488942e5335b\") "
Sep 11 21:31:59.664352 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.664326    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7849f1fa-1ad4-4774-9d3d-488942e5335b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7849f1fa-1ad4-4774-9d3d-488942e5335b" (UID: "7849f1fa-1ad4-4774-9d3d-488942e5335b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:31:59.666057 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.666025    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7849f1fa-1ad4-4774-9d3d-488942e5335b-kube-api-access-n2xwt" (OuterVolumeSpecName: "kube-api-access-n2xwt") pod "7849f1fa-1ad4-4774-9d3d-488942e5335b" (UID: "7849f1fa-1ad4-4774-9d3d-488942e5335b"). InnerVolumeSpecName "kube-api-access-n2xwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:31:59.765233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.765187    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7849f1fa-1ad4-4774-9d3d-488942e5335b-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:31:59.765233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.765228    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2xwt\" (UniqueName: \"kubernetes.io/projected/7849f1fa-1ad4-4774-9d3d-488942e5335b-kube-api-access-n2xwt\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:31:59.882843 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:31:59.882749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:00.028764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.028717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:00.156341 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.156309    2572 generic.go:356] "Generic (PLEG): container finished" podID="7849f1fa-1ad4-4774-9d3d-488942e5335b" containerID="2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652" exitCode=0
Sep 11 21:32:00.156491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.156347    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"
Sep 11 21:32:00.156491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.156400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2" event={"ID":"7849f1fa-1ad4-4774-9d3d-488942e5335b","Type":"ContainerDied","Data":"2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652"}
Sep 11 21:32:00.156491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.156463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2" event={"ID":"7849f1fa-1ad4-4774-9d3d-488942e5335b","Type":"ContainerDied","Data":"d5e722dc784d1d60bc73461deb9ae36cf1c05eb9328040356048bd1ec3ba7bc1"}
Sep 11 21:32:00.156628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.156496    2572 scope.go:117] "RemoveContainer" containerID="2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652"
Sep 11 21:32:00.166224 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.166206    2572 scope.go:117] "RemoveContainer" containerID="2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652"
Sep 11 21:32:00.166544 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:32:00.166526    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652\": container with ID starting with 2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652 not found: ID does not exist" containerID="2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652"
Sep 11 21:32:00.166623 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.166552    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652"} err="failed to get container status \"2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652\": rpc error: code = NotFound desc = could not find container \"2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652\": container with ID starting with 2ce2f98de261d1cecb75e91eae27dc76ae61458fa541ad21541a08752d9d4652 not found: ID does not exist"
Sep 11 21:32:00.176088 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.176066    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"]
Sep 11 21:32:00.178617 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.178598    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-1e9b41-97fffb6c4-4mkn2"]
Sep 11 21:32:00.942844 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:00.942804    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:02.122336 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:02.122281    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:02.144664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:02.144630    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7849f1fa-1ad4-4774-9d3d-488942e5335b" path="/var/lib/kubelet/pods/7849f1fa-1ad4-4774-9d3d-488942e5335b/volumes"
Sep 11 21:32:02.913450 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:02.913410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:03.774980 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:03.774948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:04.605848 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:04.605809    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:04.944113 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:04.943994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:05.290690 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:05.290654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:06.093552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:06.093514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:11.310133 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:11.310036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:12.103053 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.103009    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"]
Sep 11 21:32:12.103322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.103295    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" podUID="143789c7-f204-4058-8b5a-6a844edcf48f" containerName="maas-api" containerID="cri-o://d3ed7f1bf9ba49b2753bad43f6eb954eaa7e06a78d579ef354f999c9054e78c5" gracePeriod=30
Sep 11 21:32:12.142460 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.142427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:12.223776 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.223745    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"]
Sep 11 21:32:12.224179 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.224146    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw" podUID="15234ad0-c9a0-4a39-bf91-d08adddaa32e" containerName="payload-pre-processing" containerID="cri-o://e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01" gracePeriod=30
Sep 11 21:32:12.239816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.239722    2572 generic.go:356] "Generic (PLEG): container finished" podID="143789c7-f204-4058-8b5a-6a844edcf48f" containerID="d3ed7f1bf9ba49b2753bad43f6eb954eaa7e06a78d579ef354f999c9054e78c5" exitCode=0
Sep 11 21:32:12.240684 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.239834    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" event={"ID":"143789c7-f204-4058-8b5a-6a844edcf48f","Type":"ContainerDied","Data":"d3ed7f1bf9ba49b2753bad43f6eb954eaa7e06a78d579ef354f999c9054e78c5"}
Sep 11 21:32:12.262277 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.262211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:12.341398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.341364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:12.369758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.369692    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:32:12.438872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.438825    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:12.492591 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.492567    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:32:12.492729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.492646    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-metrics-certs\") pod \"143789c7-f204-4058-8b5a-6a844edcf48f\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") "
Sep 11 21:32:12.492773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.492735    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls\") pod \"143789c7-f204-4058-8b5a-6a844edcf48f\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") "
Sep 11 21:32:12.492809 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.492790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/143789c7-f204-4058-8b5a-6a844edcf48f-openshift-service-ca\") pod \"143789c7-f204-4058-8b5a-6a844edcf48f\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") "
Sep 11 21:32:12.492857 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.492845    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/143789c7-f204-4058-8b5a-6a844edcf48f-kube-api-access-9jd2c\") pod \"143789c7-f204-4058-8b5a-6a844edcf48f\" (UID: \"143789c7-f204-4058-8b5a-6a844edcf48f\") "
Sep 11 21:32:12.493233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.493197    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/143789c7-f204-4058-8b5a-6a844edcf48f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "143789c7-f204-4058-8b5a-6a844edcf48f" (UID: "143789c7-f204-4058-8b5a-6a844edcf48f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:32:12.494842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.494815    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "143789c7-f204-4058-8b5a-6a844edcf48f" (UID: "143789c7-f204-4058-8b5a-6a844edcf48f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:32:12.495442 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.495413    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "143789c7-f204-4058-8b5a-6a844edcf48f" (UID: "143789c7-f204-4058-8b5a-6a844edcf48f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:32:12.495442 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.495424    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/143789c7-f204-4058-8b5a-6a844edcf48f-kube-api-access-9jd2c" (OuterVolumeSpecName: "kube-api-access-9jd2c") pod "143789c7-f204-4058-8b5a-6a844edcf48f" (UID: "143789c7-f204-4058-8b5a-6a844edcf48f"). InnerVolumeSpecName "kube-api-access-9jd2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:12.593607 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.593570    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8lhq\" (UniqueName: \"kubernetes.io/projected/15234ad0-c9a0-4a39-bf91-d08adddaa32e-kube-api-access-f8lhq\") pod \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") "
Sep 11 21:32:12.593789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.593755    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15234ad0-c9a0-4a39-bf91-d08adddaa32e-plugins-config-volume\") pod \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\" (UID: \"15234ad0-c9a0-4a39-bf91-d08adddaa32e\") "
Sep 11 21:32:12.594400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.594089    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jd2c\" (UniqueName: \"kubernetes.io/projected/143789c7-f204-4058-8b5a-6a844edcf48f-kube-api-access-9jd2c\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.594400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.594113    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.594400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.594128    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/143789c7-f204-4058-8b5a-6a844edcf48f-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.594400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.594141    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/143789c7-f204-4058-8b5a-6a844edcf48f-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.594400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.594164    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15234ad0-c9a0-4a39-bf91-d08adddaa32e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15234ad0-c9a0-4a39-bf91-d08adddaa32e" (UID: "15234ad0-c9a0-4a39-bf91-d08adddaa32e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:32:12.595049 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.595023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:12.597884 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.597861    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15234ad0-c9a0-4a39-bf91-d08adddaa32e-kube-api-access-f8lhq" (OuterVolumeSpecName: "kube-api-access-f8lhq") pod "15234ad0-c9a0-4a39-bf91-d08adddaa32e" (UID: "15234ad0-c9a0-4a39-bf91-d08adddaa32e"). InnerVolumeSpecName "kube-api-access-f8lhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:12.695149 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.695074    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15234ad0-c9a0-4a39-bf91-d08adddaa32e-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.695149 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.695099    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8lhq\" (UniqueName: \"kubernetes.io/projected/15234ad0-c9a0-4a39-bf91-d08adddaa32e-kube-api-access-f8lhq\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:32:12.713470 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:12.713427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:13.146459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.146425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:13.247411 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.247379    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"
Sep 11 21:32:13.247561 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.247384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp" event={"ID":"143789c7-f204-4058-8b5a-6a844edcf48f","Type":"ContainerDied","Data":"cbff6520b46b2912ba5d805dfa0aed5f596bf14617ad852511f1c0b00c1e9d8d"}
Sep 11 21:32:13.247561 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.247526    2572 scope.go:117] "RemoveContainer" containerID="d3ed7f1bf9ba49b2753bad43f6eb954eaa7e06a78d579ef354f999c9054e78c5"
Sep 11 21:32:13.249051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.248836    2572 generic.go:356] "Generic (PLEG): container finished" podID="15234ad0-c9a0-4a39-bf91-d08adddaa32e" containerID="e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01" exitCode=0
Sep 11 21:32:13.249051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.248876    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"
Sep 11 21:32:13.249051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.248882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw" event={"ID":"15234ad0-c9a0-4a39-bf91-d08adddaa32e","Type":"ContainerDied","Data":"e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01"}
Sep 11 21:32:13.249051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.248927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw" event={"ID":"15234ad0-c9a0-4a39-bf91-d08adddaa32e","Type":"ContainerDied","Data":"8165c918e77df74e848ce6cb07f73957867b8e30b23e68d4be69df0be606e00c"}
Sep 11 21:32:13.257584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.257568    2572 scope.go:117] "RemoveContainer" containerID="e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01"
Sep 11 21:32:13.266975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.266957    2572 scope.go:117] "RemoveContainer" containerID="e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01"
Sep 11 21:32:13.267225 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:32:13.267202    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01\": container with ID starting with e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01 not found: ID does not exist" containerID="e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01"
Sep 11 21:32:13.267331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.267230    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01"} err="failed to get container status \"e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01\": rpc error: code = NotFound desc = could not find container \"e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01\": container with ID starting with e831e1f89be5acaa241825dd7efd4e9ab2cbe0e4307c23ba6e15ce71e954fc01 not found: ID does not exist"
Sep 11 21:32:13.298595 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.298562    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"]
Sep 11 21:32:13.305662 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.305635    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0cd86cdc-764bf8cf94-l2zkw"]
Sep 11 21:32:13.335888 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.335853    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"]
Sep 11 21:32:13.353817 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.353787    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0cd86cdc-564fdf44bf-nhskp"]
Sep 11 21:32:13.398436 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.398347    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:13.513780 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:13.513746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:14.144132 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:14.144099    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="143789c7-f204-4058-8b5a-6a844edcf48f" path="/var/lib/kubelet/pods/143789c7-f204-4058-8b5a-6a844edcf48f/volumes"
Sep 11 21:32:14.144521 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:14.144506    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15234ad0-c9a0-4a39-bf91-d08adddaa32e" path="/var/lib/kubelet/pods/15234ad0-c9a0-4a39-bf91-d08adddaa32e/volumes"
Sep 11 21:32:14.322302 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:14.322267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:15.044789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:15.044750    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:15.177778 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:15.177742    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:15.966971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:15.966929    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:16.716475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:16.716438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:18.161268 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:18.161233    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:32:18.164042 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:18.164019    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:32:20.663137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:20.663102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:20.770678 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:20.770644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:20.929622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:20.929520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:21.044906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:21.044869    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:21.562167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:21.562135    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:22.727076 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:22.727047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:41.204290 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:41.204225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:42.442202 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:42.442169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:42.694480 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:42.694382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:42.962418 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:42.962325    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.033463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:43.033427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.151552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:43.151519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.456762 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:43.456722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.733876 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:43.733782    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:45.698856 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:45.698818    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:46.496606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:46.496558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:46.596571 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:46.596534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:47.322807 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:47.322774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:48.423059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:48.423024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:49.206023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:49.205980    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:49.906567 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:49.906534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:50.005545 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.005506    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:50.378622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.378586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:50.474500 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.474464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:50.476503 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.476479    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"]
Sep 11 21:32:50.476972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.476959    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="143789c7-f204-4058-8b5a-6a844edcf48f" containerName="maas-api"
Sep 11 21:32:50.477019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.476974    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="143789c7-f204-4058-8b5a-6a844edcf48f" containerName="maas-api"
Sep 11 21:32:50.477019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477005    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15234ad0-c9a0-4a39-bf91-d08adddaa32e" containerName="payload-pre-processing"
Sep 11 21:32:50.477019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477014    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="15234ad0-c9a0-4a39-bf91-d08adddaa32e" containerName="payload-pre-processing"
Sep 11 21:32:50.477117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477026    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7849f1fa-1ad4-4774-9d3d-488942e5335b" containerName="payload-pre-processing"
Sep 11 21:32:50.477117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477033    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7849f1fa-1ad4-4774-9d3d-488942e5335b" containerName="payload-pre-processing"
Sep 11 21:32:50.477117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477099    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="143789c7-f204-4058-8b5a-6a844edcf48f" containerName="maas-api"
Sep 11 21:32:50.477117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477105    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7849f1fa-1ad4-4774-9d3d-488942e5335b" containerName="payload-pre-processing"
Sep 11 21:32:50.477117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.477117    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="15234ad0-c9a0-4a39-bf91-d08adddaa32e" containerName="payload-pre-processing"
Sep 11 21:32:50.482305 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.482268    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.485584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.485302    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c0162b\""
Sep 11 21:32:50.492605 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.492576    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"]
Sep 11 21:32:50.518604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.518565    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"]
Sep 11 21:32:50.522534 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.522507    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.525265 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.525232    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c0162b-dockercfg-qjf2k\""
Sep 11 21:32:50.541378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.541341    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"]
Sep 11 21:32:50.566775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.566728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb17b2-f547-413e-8059-1267aee1f820-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.566958 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.566782    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcszc\" (UniqueName: \"kubernetes.io/projected/d6fb17b2-f547-413e-8059-1267aee1f820-kube-api-access-bcszc\") pod \"payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.668496 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.668382    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9r9\" (UniqueName: \"kubernetes.io/projected/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-kube-api-access-xz9r9\") pod \"payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.668679 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.668551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb17b2-f547-413e-8059-1267aee1f820-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.668679 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.668590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcszc\" (UniqueName: \"kubernetes.io/projected/d6fb17b2-f547-413e-8059-1267aee1f820-kube-api-access-bcszc\") pod \"payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.668679 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.668630    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.669612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.669582    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb17b2-f547-413e-8059-1267aee1f820-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.677139 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.677112    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcszc\" (UniqueName: \"kubernetes.io/projected/d6fb17b2-f547-413e-8059-1267aee1f820-kube-api-access-bcszc\") pod \"payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.769622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.769571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.769834 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.769638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9r9\" (UniqueName: \"kubernetes.io/projected/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-kube-api-access-xz9r9\") pod \"payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.770414 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.770390    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.778508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.778481    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9r9\" (UniqueName: \"kubernetes.io/projected/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-kube-api-access-xz9r9\") pod \"payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") " pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:50.796926 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.796888    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:50.833416 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:50.833377    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:51.076077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.076048    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"]
Sep 11 21:32:51.076513 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:32:51.076491    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6fb17b2_f547_413e_8059_1267aee1f820.slice/crio-de79185597b0ef2f2dcade58ecd3f3f4c3dafa08c320d37f0504a7c6872a24b5 WatchSource:0}: Error finding container de79185597b0ef2f2dcade58ecd3f3f4c3dafa08c320d37f0504a7c6872a24b5: Status 404 returned error can't find the container with id de79185597b0ef2f2dcade58ecd3f3f4c3dafa08c320d37f0504a7c6872a24b5
Sep 11 21:32:51.130980 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.130953    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"]
Sep 11 21:32:51.132140 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:32:51.132112    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d616c9d_a8c3_4d97_b59b_1efd3f34309c.slice/crio-80cb981515cbbf2df8e38ded2aaa239ce8c2b48646a6665fa39e8754b82668a5 WatchSource:0}: Error finding container 80cb981515cbbf2df8e38ded2aaa239ce8c2b48646a6665fa39e8754b82668a5: Status 404 returned error can't find the container with id 80cb981515cbbf2df8e38ded2aaa239ce8c2b48646a6665fa39e8754b82668a5
Sep 11 21:32:51.497875 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.497831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d" event={"ID":"d6fb17b2-f547-413e-8059-1267aee1f820","Type":"ContainerStarted","Data":"6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f"}
Sep 11 21:32:51.498062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.497915    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:32:51.498062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.497943    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d" event={"ID":"d6fb17b2-f547-413e-8059-1267aee1f820","Type":"ContainerStarted","Data":"de79185597b0ef2f2dcade58ecd3f3f4c3dafa08c320d37f0504a7c6872a24b5"}
Sep 11 21:32:51.499508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.499480    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp" event={"ID":"2d616c9d-a8c3-4d97-b59b-1efd3f34309c","Type":"ContainerStarted","Data":"4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c"}
Sep 11 21:32:51.499628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.499529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp" event={"ID":"2d616c9d-a8c3-4d97-b59b-1efd3f34309c","Type":"ContainerStarted","Data":"80cb981515cbbf2df8e38ded2aaa239ce8c2b48646a6665fa39e8754b82668a5"}
Sep 11 21:32:51.499628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.499551    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:32:51.518322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.518269    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d" podStartSLOduration=1.518240668 podStartE2EDuration="1.518240668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:51.515360187 +0000 UTC m=+933.827585555" watchObservedRunningTime="2026-09-11 21:32:51.518240668 +0000 UTC m=+933.830466100"
Sep 11 21:32:51.548405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:51.548348    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp" podStartSLOduration=1.548331052 podStartE2EDuration="1.548331052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:51.544642064 +0000 UTC m=+933.856867433" watchObservedRunningTime="2026-09-11 21:32:51.548331052 +0000 UTC m=+933.860556418"
Sep 11 21:32:53.499376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:53.499303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:53.608014 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:53.607972    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:53.703375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:32:53.703334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:02.507867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:02.507833    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:33:02.508318 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:02.507903    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:33:07.575302 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:07.575239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:09.576991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:09.576950    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:10.228565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:10.228531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:11.986148 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:11.986107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:12.940448 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:12.940406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:13.676290 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:13.676223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:14.371934 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:14.371904    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:15.199337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:15.199299    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:16.058618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:16.058580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:16.172600 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:16.172556    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:16.270558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:16.270520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:16.610559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:16.610523    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:24.817689 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:24.817650    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:26.771744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:26.771706    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:27.587135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:27.587094    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:33.947787 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:33.947745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:34.018029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:34.017995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:34.124853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:34.124815    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:34.220974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:34.220880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:34.323316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:34.323240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:34.974996 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:34.974959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:35.074791 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:35.074754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:35.176631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:35.176595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:36.639837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:36.639802    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:41.884457 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:41.884368    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:42.785797 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:42.785758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:42.888214 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:42.888181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:43.445175 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:43.445134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:46.614701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:46.614666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.587632 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:49.587597    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.688084 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:49.688046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.859584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:49.859496    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:50.296323 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:50.296281    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:50.454665 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:50.454632    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:55.820799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:55.820706    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:56.556877 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:56.556843    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:56.638049 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:56.638006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:57.795100 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:57.795063    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:58.601966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:58.601923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:59.373604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:59.373556    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:59.886002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:33:59.885970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:00.267026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:00.266986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:01.066359 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.066325    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"]
Sep 11 21:34:01.070411 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.070388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.072959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.072930    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0ddeac18-serving-cert\""
Sep 11 21:34:01.083090 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.081085    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"]
Sep 11 21:34:01.105697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.105654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:01.151355 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.151320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv28t\" (UniqueName: \"kubernetes.io/projected/5ed19225-94ff-498e-bb17-798573d9fd1d-kube-api-access-qv28t\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.151355 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.151362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.151616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.151484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-metrics-certs\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.151616 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.151594    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed19225-94ff-498e-bb17-798573d9fd1d-openshift-service-ca\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.207422 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.207381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:01.252710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.252670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed19225-94ff-498e-bb17-798573d9fd1d-openshift-service-ca\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.252896 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.252755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv28t\" (UniqueName: \"kubernetes.io/projected/5ed19225-94ff-498e-bb17-798573d9fd1d-kube-api-access-qv28t\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.252896 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.252777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.252896 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.252813    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-metrics-certs\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.253077 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:34:01.252929    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-serving-cert: secret "maas-api-e2e-mt-0ddeac18-serving-cert" not found
Sep 11 21:34:01.253077 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:34:01.253002    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls podName:5ed19225-94ff-498e-bb17-798573d9fd1d nodeName:}" failed. No retries permitted until 2026-09-11 21:34:01.752982582 +0000 UTC m=+1004.065207933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls") pod "maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" (UID: "5ed19225-94ff-498e-bb17-798573d9fd1d") : secret "maas-api-e2e-mt-0ddeac18-serving-cert" not found
Sep 11 21:34:01.253511 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.253481    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed19225-94ff-498e-bb17-798573d9fd1d-openshift-service-ca\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.255161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.255144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-metrics-certs\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.263623 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.263595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv28t\" (UniqueName: \"kubernetes.io/projected/5ed19225-94ff-498e-bb17-798573d9fd1d-kube-api-access-qv28t\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.365970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.365873    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:01.578167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.578128    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:01.680486 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.680395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:01.724718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.724684    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"]
Sep 11 21:34:01.728705 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.728688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.731894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.731866    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0ddeac18\""
Sep 11 21:34:01.732022 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.732001    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0ddeac18-dockercfg-t62nl\""
Sep 11 21:34:01.739887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.739862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"]
Sep 11 21:34:01.757931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.757902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.758059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.757948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ce580e-31ac-439a-a988-f400877e1dbe-plugins-config-volume\") pod \"payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") " pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.758130 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.758111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsqsl\" (UniqueName: \"kubernetes.io/projected/45ce580e-31ac-439a-a988-f400877e1dbe-kube-api-access-zsqsl\") pod \"payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") " pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.760224 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.760205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls\") pod \"maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:01.858808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.858770    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsqsl\" (UniqueName: \"kubernetes.io/projected/45ce580e-31ac-439a-a988-f400877e1dbe-kube-api-access-zsqsl\") pod \"payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") " pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.859024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.858823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ce580e-31ac-439a-a988-f400877e1dbe-plugins-config-volume\") pod \"payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") " pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.859544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.859525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ce580e-31ac-439a-a988-f400877e1dbe-plugins-config-volume\") pod \"payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") " pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.867031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.867001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsqsl\" (UniqueName: \"kubernetes.io/projected/45ce580e-31ac-439a-a988-f400877e1dbe-kube-api-access-zsqsl\") pod \"payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") " pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:01.986689 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:01.986607    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:02.041401 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.041289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:02.228059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.228024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:02.263127 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:34:02.263096    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed19225_94ff_498e_bb17_798573d9fd1d.slice/crio-0696cdafa26689f18e39918c66f6af01e0776fe1ddca8c97a69ba6236e7ae4bf WatchSource:0}: Error finding container 0696cdafa26689f18e39918c66f6af01e0776fe1ddca8c97a69ba6236e7ae4bf: Status 404 returned error can't find the container with id 0696cdafa26689f18e39918c66f6af01e0776fe1ddca8c97a69ba6236e7ae4bf
Sep 11 21:34:02.263979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.263949    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"]
Sep 11 21:34:02.324209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.324183    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"]
Sep 11 21:34:02.325354 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:34:02.325328    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ce580e_31ac_439a_a988_f400877e1dbe.slice/crio-fe6ff820dee5b312adf1caf9f42e8d2bc5d0a40dd72fee0115baffebdbaafab8 WatchSource:0}: Error finding container fe6ff820dee5b312adf1caf9f42e8d2bc5d0a40dd72fee0115baffebdbaafab8: Status 404 returned error can't find the container with id fe6ff820dee5b312adf1caf9f42e8d2bc5d0a40dd72fee0115baffebdbaafab8
Sep 11 21:34:02.935389 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.935357    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp" event={"ID":"45ce580e-31ac-439a-a988-f400877e1dbe","Type":"ContainerStarted","Data":"ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9"}
Sep 11 21:34:02.935565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.935409    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp" event={"ID":"45ce580e-31ac-439a-a988-f400877e1dbe","Type":"ContainerStarted","Data":"fe6ff820dee5b312adf1caf9f42e8d2bc5d0a40dd72fee0115baffebdbaafab8"}
Sep 11 21:34:02.935565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.935535    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:02.937398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.937374    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" event={"ID":"5ed19225-94ff-498e-bb17-798573d9fd1d","Type":"ContainerStarted","Data":"22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745"}
Sep 11 21:34:02.937553 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.937421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" event={"ID":"5ed19225-94ff-498e-bb17-798573d9fd1d","Type":"ContainerStarted","Data":"0696cdafa26689f18e39918c66f6af01e0776fe1ddca8c97a69ba6236e7ae4bf"}
Sep 11 21:34:02.937553 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.937512    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:02.953166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.953063    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp" podStartSLOduration=1.953046067 podStartE2EDuration="1.953046067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:02.951972005 +0000 UTC m=+1005.264197372" watchObservedRunningTime="2026-09-11 21:34:02.953046067 +0000 UTC m=+1005.265271437"
Sep 11 21:34:02.971500 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:02.971450    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" podStartSLOduration=1.541289854 podStartE2EDuration="1.9714394s" totalImagesPullingTime="430.149546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:02.968908821 +0000 UTC m=+1005.281134188" watchObservedRunningTime="2026-09-11 21:34:02.9714394 +0000 UTC m=+1005.283664767"
Sep 11 21:34:03.024637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:03.024589    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:03.772737 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:03.772705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:04.588360 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:04.588326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:05.403015 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:05.402972    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:06.111985 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:06.111943    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:06.773578 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:06.773542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:08.949570 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:08.949538    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:10.305400 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.305365    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:10.905938 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.905906    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:10.934731 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.934699    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"]
Sep 11 21:34:10.934966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.934934    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp" podUID="2d616c9d-a8c3-4d97-b59b-1efd3f34309c" containerName="payload-processing" containerID="cri-o://4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c" gracePeriod=30
Sep 11 21:34:10.941767 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.941734    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"]
Sep 11 21:34:10.941989 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.941963    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d" podUID="d6fb17b2-f547-413e-8059-1267aee1f820" containerName="payload-pre-processing" containerID="cri-o://6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f" gracePeriod=30
Sep 11 21:34:10.975936 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:10.975895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:11.038745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.038710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:11.106908 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.106856    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:11.172210 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.172066    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:11.236168 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.236142    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:34:11.238201 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.238183    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:34:11.359503 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.359475    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-plugins-config-volume\") pod \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") "
Sep 11 21:34:11.359882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.359518    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcszc\" (UniqueName: \"kubernetes.io/projected/d6fb17b2-f547-413e-8059-1267aee1f820-kube-api-access-bcszc\") pod \"d6fb17b2-f547-413e-8059-1267aee1f820\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") "
Sep 11 21:34:11.359882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.359567    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb17b2-f547-413e-8059-1267aee1f820-plugins-config-volume\") pod \"d6fb17b2-f547-413e-8059-1267aee1f820\" (UID: \"d6fb17b2-f547-413e-8059-1267aee1f820\") "
Sep 11 21:34:11.359882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.359632    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz9r9\" (UniqueName: \"kubernetes.io/projected/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-kube-api-access-xz9r9\") pod \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\" (UID: \"2d616c9d-a8c3-4d97-b59b-1efd3f34309c\") "
Sep 11 21:34:11.359882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.359843    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d616c9d-a8c3-4d97-b59b-1efd3f34309c" (UID: "2d616c9d-a8c3-4d97-b59b-1efd3f34309c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:11.360037 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.360013    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:11.360037 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.360022    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6fb17b2-f547-413e-8059-1267aee1f820-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6fb17b2-f547-413e-8059-1267aee1f820" (UID: "d6fb17b2-f547-413e-8059-1267aee1f820"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:11.361656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.361626    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-kube-api-access-xz9r9" (OuterVolumeSpecName: "kube-api-access-xz9r9") pod "2d616c9d-a8c3-4d97-b59b-1efd3f34309c" (UID: "2d616c9d-a8c3-4d97-b59b-1efd3f34309c"). InnerVolumeSpecName "kube-api-access-xz9r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:11.361758 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.361720    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6fb17b2-f547-413e-8059-1267aee1f820-kube-api-access-bcszc" (OuterVolumeSpecName: "kube-api-access-bcszc") pod "d6fb17b2-f547-413e-8059-1267aee1f820" (UID: "d6fb17b2-f547-413e-8059-1267aee1f820"). InnerVolumeSpecName "kube-api-access-bcszc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:11.461329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.461222    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcszc\" (UniqueName: \"kubernetes.io/projected/d6fb17b2-f547-413e-8059-1267aee1f820-kube-api-access-bcszc\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:11.461329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.461265    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6fb17b2-f547-413e-8059-1267aee1f820-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:11.461329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.461283    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz9r9\" (UniqueName: \"kubernetes.io/projected/2d616c9d-a8c3-4d97-b59b-1efd3f34309c-kube-api-access-xz9r9\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:11.467607 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.467571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:11.567917 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.567881    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:11.998043 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.998013    2572 generic.go:356] "Generic (PLEG): container finished" podID="d6fb17b2-f547-413e-8059-1267aee1f820" containerID="6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f" exitCode=0
Sep 11 21:34:11.998247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.998060    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"
Sep 11 21:34:11.998247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.998104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d" event={"ID":"d6fb17b2-f547-413e-8059-1267aee1f820","Type":"ContainerDied","Data":"6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f"}
Sep 11 21:34:11.998247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.998156    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d" event={"ID":"d6fb17b2-f547-413e-8059-1267aee1f820","Type":"ContainerDied","Data":"de79185597b0ef2f2dcade58ecd3f3f4c3dafa08c320d37f0504a7c6872a24b5"}
Sep 11 21:34:11.998247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.998177    2572 scope.go:117] "RemoveContainer" containerID="6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f"
Sep 11 21:34:11.999661 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.999639    2572 generic.go:356] "Generic (PLEG): container finished" podID="2d616c9d-a8c3-4d97-b59b-1efd3f34309c" containerID="4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c" exitCode=0
Sep 11 21:34:11.999722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.999692    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"
Sep 11 21:34:11.999783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.999719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp" event={"ID":"2d616c9d-a8c3-4d97-b59b-1efd3f34309c","Type":"ContainerDied","Data":"4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c"}
Sep 11 21:34:11.999839 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:11.999774    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp" event={"ID":"2d616c9d-a8c3-4d97-b59b-1efd3f34309c","Type":"ContainerDied","Data":"80cb981515cbbf2df8e38ded2aaa239ce8c2b48646a6665fa39e8754b82668a5"}
Sep 11 21:34:12.010372 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.010348    2572 scope.go:117] "RemoveContainer" containerID="6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f"
Sep 11 21:34:12.010676 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:34:12.010657    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f\": container with ID starting with 6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f not found: ID does not exist" containerID="6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f"
Sep 11 21:34:12.010753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.010685    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f"} err="failed to get container status \"6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f\": rpc error: code = NotFound desc = could not find container \"6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f\": container with ID starting with 6cc7c4f084e870357e790bae7a471698132461942f487209fb9523f4b2522b7f not found: ID does not exist"
Sep 11 21:34:12.010753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.010702    2572 scope.go:117] "RemoveContainer" containerID="4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c"
Sep 11 21:34:12.019703 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.019680    2572 scope.go:117] "RemoveContainer" containerID="4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c"
Sep 11 21:34:12.019952 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:34:12.019931    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c\": container with ID starting with 4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c not found: ID does not exist" containerID="4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c"
Sep 11 21:34:12.020018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.019958    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c"} err="failed to get container status \"4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c\": rpc error: code = NotFound desc = could not find container \"4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c\": container with ID starting with 4c595ca5200e2265d82930f6ce49847e8302a3037e2985e160581280a2e1321c not found: ID does not exist"
Sep 11 21:34:12.024380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.024355    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"]
Sep 11 21:34:12.028513 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.028491    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c0162b-54dfc875b6-rl48d"]
Sep 11 21:34:12.042140 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.042113    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"]
Sep 11 21:34:12.046644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.046614    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c0162b-5b9cbddd69-5bgmp"]
Sep 11 21:34:12.144817 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.144777    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d616c9d-a8c3-4d97-b59b-1efd3f34309c" path="/var/lib/kubelet/pods/2d616c9d-a8c3-4d97-b59b-1efd3f34309c/volumes"
Sep 11 21:34:12.145356 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.145340    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6fb17b2-f547-413e-8059-1267aee1f820" path="/var/lib/kubelet/pods/d6fb17b2-f547-413e-8059-1267aee1f820/volumes"
Sep 11 21:34:12.306687 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:12.306600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:13.093765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:13.093730    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:13.790632 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:13.790601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:13.946708 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:13.946670    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:14.696357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:14.696320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:15.391605 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:15.391571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:16.209385 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:16.209355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:16.339649 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:16.339611    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:16.987037 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:16.986990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:17.091340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:17.091301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:17.559382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:17.559341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:18.480425 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:18.480382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:18.653413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:18.653318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:18.785853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:18.785824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:19.198023 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:19.197988    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:19.519516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:19.519480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:19.757430 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:19.757384    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:20.540990 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:20.540954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:20.634769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:20.634737    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:20.750735 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:20.750698    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:22.086602 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:22.086563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:23.478945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:23.478906    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:23.579329 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:23.579283    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:24.701441 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:24.701399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:25.470065 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:25.470026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:26.154318 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:26.154279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:26.903887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:26.903831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:27.697729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:27.697692    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:28.413585 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:28.413535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:32.782171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.782125    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"]
Sep 11 21:34:32.782831 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.782810    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6fb17b2-f547-413e-8059-1267aee1f820" containerName="payload-pre-processing"
Sep 11 21:34:32.782921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.782833    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6fb17b2-f547-413e-8059-1267aee1f820" containerName="payload-pre-processing"
Sep 11 21:34:32.782921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.782847    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d616c9d-a8c3-4d97-b59b-1efd3f34309c" containerName="payload-processing"
Sep 11 21:34:32.782921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.782856    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d616c9d-a8c3-4d97-b59b-1efd3f34309c" containerName="payload-processing"
Sep 11 21:34:32.783078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.782997    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6fb17b2-f547-413e-8059-1267aee1f820" containerName="payload-pre-processing"
Sep 11 21:34:32.783078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.783013    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d616c9d-a8c3-4d97-b59b-1efd3f34309c" containerName="payload-processing"
Sep 11 21:34:32.787626 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.787603    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:32.790532 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.790504    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-83ba87\"/\"kube-root-ca.crt\""
Sep 11 21:34:32.790963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.790943    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-83ba87\"/\"openshift-service-ca.crt\""
Sep 11 21:34:32.791497 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.791475    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-83ba87\"/\"default-dockercfg-p92xg\""
Sep 11 21:34:32.791625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.791515    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-83ba87\"/\"e2e-conflict-a-315f74cf-kserve-self-signed-certs\""
Sep 11 21:34:32.793729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.793707    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"]
Sep 11 21:34:32.974498 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.974451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:32.982682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.982656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tls-certs\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:32.982788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.982695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-home\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:32.982788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.982723    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5652k\" (UniqueName: \"kubernetes.io/projected/2bcb80f9-9b3b-4957-ae0d-186bb452574b-kube-api-access-5652k\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:32.982788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.982743    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-model-cache\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:32.982909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.982818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-dshm\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:32.982909 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:32.982846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tmp-dir\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.083773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.083684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-dshm\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.083773 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.083725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tmp-dir\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.083979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.083794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tls-certs\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.083979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.083817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-home\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.083979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.083845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5652k\" (UniqueName: \"kubernetes.io/projected/2bcb80f9-9b3b-4957-ae0d-186bb452574b-kube-api-access-5652k\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.083979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.083872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-model-cache\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.084246 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.084218    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-home\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.084324 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.084278    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tmp-dir\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.084377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.084332    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-model-cache\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.086030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.086011    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-dshm\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.086314 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.086298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tls-certs\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.091204 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.091180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5652k\" (UniqueName: \"kubernetes.io/projected/2bcb80f9-9b3b-4957-ae0d-186bb452574b-kube-api-access-5652k\") pod \"e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") " pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.098707 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.098680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:33.374904 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:33.374872    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"]
Sep 11 21:34:33.375923 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:34:33.375897    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bcb80f9_9b3b_4957_ae0d_186bb452574b.slice/crio-8ef69ae773f3a1acebf88fdc1e10df7be5b217e06b60f3ffe95d8bb9f3a2634d WatchSource:0}: Error finding container 8ef69ae773f3a1acebf88fdc1e10df7be5b217e06b60f3ffe95d8bb9f3a2634d: Status 404 returned error can't find the container with id 8ef69ae773f3a1acebf88fdc1e10df7be5b217e06b60f3ffe95d8bb9f3a2634d
Sep 11 21:34:34.143724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:34.143693    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z" event={"ID":"2bcb80f9-9b3b-4957-ae0d-186bb452574b","Type":"ContainerStarted","Data":"cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca"}
Sep 11 21:34:34.144119 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:34.143731    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z" event={"ID":"2bcb80f9-9b3b-4957-ae0d-186bb452574b","Type":"ContainerStarted","Data":"8ef69ae773f3a1acebf88fdc1e10df7be5b217e06b60f3ffe95d8bb9f3a2634d"}
Sep 11 21:34:34.162978 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:34.162923    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z" podStartSLOduration=2.162904909 podStartE2EDuration="2.162904909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:34.160641946 +0000 UTC m=+1036.472867314" watchObservedRunningTime="2026-09-11 21:34:34.162904909 +0000 UTC m=+1036.475130299"
Sep 11 21:34:38.206179 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.206143    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"]
Sep 11 21:34:38.206615 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.206361    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" podUID="5ed19225-94ff-498e-bb17-798573d9fd1d" containerName="maas-api" containerID="cri-o://22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745" gracePeriod=30
Sep 11 21:34:38.232985 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.232946    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.268838 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.268805    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"]
Sep 11 21:34:38.269057 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.269031    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp" podUID="45ce580e-31ac-439a-a988-f400877e1dbe" containerName="payload-processing" containerID="cri-o://ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9" gracePeriod=30
Sep 11 21:34:38.330488 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.330453    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.445569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.445487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.511963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.511901    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.534273 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.534235    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:38.571660 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.571629    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:38.636408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636371    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv28t\" (UniqueName: \"kubernetes.io/projected/5ed19225-94ff-498e-bb17-798573d9fd1d-kube-api-access-qv28t\") pod \"5ed19225-94ff-498e-bb17-798573d9fd1d\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") "
Sep 11 21:34:38.636557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636460    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-metrics-certs\") pod \"5ed19225-94ff-498e-bb17-798573d9fd1d\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") "
Sep 11 21:34:38.636557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636507    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsqsl\" (UniqueName: \"kubernetes.io/projected/45ce580e-31ac-439a-a988-f400877e1dbe-kube-api-access-zsqsl\") pod \"45ce580e-31ac-439a-a988-f400877e1dbe\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") "
Sep 11 21:34:38.636557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636524    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls\") pod \"5ed19225-94ff-498e-bb17-798573d9fd1d\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") "
Sep 11 21:34:38.636557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636541    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ce580e-31ac-439a-a988-f400877e1dbe-plugins-config-volume\") pod \"45ce580e-31ac-439a-a988-f400877e1dbe\" (UID: \"45ce580e-31ac-439a-a988-f400877e1dbe\") "
Sep 11 21:34:38.636863 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636572    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed19225-94ff-498e-bb17-798573d9fd1d-openshift-service-ca\") pod \"5ed19225-94ff-498e-bb17-798573d9fd1d\" (UID: \"5ed19225-94ff-498e-bb17-798573d9fd1d\") "
Sep 11 21:34:38.637024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636951    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ce580e-31ac-439a-a988-f400877e1dbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45ce580e-31ac-439a-a988-f400877e1dbe" (UID: "45ce580e-31ac-439a-a988-f400877e1dbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:38.637024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.636961    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed19225-94ff-498e-bb17-798573d9fd1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ed19225-94ff-498e-bb17-798573d9fd1d" (UID: "5ed19225-94ff-498e-bb17-798573d9fd1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:38.638897 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.638872    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ce580e-31ac-439a-a988-f400877e1dbe-kube-api-access-zsqsl" (OuterVolumeSpecName: "kube-api-access-zsqsl") pod "45ce580e-31ac-439a-a988-f400877e1dbe" (UID: "45ce580e-31ac-439a-a988-f400877e1dbe"). InnerVolumeSpecName "kube-api-access-zsqsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:38.639021 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.638891    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5ed19225-94ff-498e-bb17-798573d9fd1d" (UID: "5ed19225-94ff-498e-bb17-798573d9fd1d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:38.639082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.639020    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ed19225-94ff-498e-bb17-798573d9fd1d" (UID: "5ed19225-94ff-498e-bb17-798573d9fd1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:38.639082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.639049    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed19225-94ff-498e-bb17-798573d9fd1d-kube-api-access-qv28t" (OuterVolumeSpecName: "kube-api-access-qv28t") pod "5ed19225-94ff-498e-bb17-798573d9fd1d" (UID: "5ed19225-94ff-498e-bb17-798573d9fd1d"). InnerVolumeSpecName "kube-api-access-qv28t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:38.737789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.737701    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.737789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.737734    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsqsl\" (UniqueName: \"kubernetes.io/projected/45ce580e-31ac-439a-a988-f400877e1dbe-kube-api-access-zsqsl\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.737789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.737743    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ed19225-94ff-498e-bb17-798573d9fd1d-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.737789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.737752    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ce580e-31ac-439a-a988-f400877e1dbe-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.737789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.737760    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed19225-94ff-498e-bb17-798573d9fd1d-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.737789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.737771    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv28t\" (UniqueName: \"kubernetes.io/projected/5ed19225-94ff-498e-bb17-798573d9fd1d-kube-api-access-qv28t\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:34:38.801017 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.800977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.903681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:38.903644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:39.175751 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.175711    2572 generic.go:356] "Generic (PLEG): container finished" podID="5ed19225-94ff-498e-bb17-798573d9fd1d" containerID="22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745" exitCode=0
Sep 11 21:34:39.175959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.175763    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"
Sep 11 21:34:39.175959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.175799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" event={"ID":"5ed19225-94ff-498e-bb17-798573d9fd1d","Type":"ContainerDied","Data":"22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745"}
Sep 11 21:34:39.175959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.175849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd" event={"ID":"5ed19225-94ff-498e-bb17-798573d9fd1d","Type":"ContainerDied","Data":"0696cdafa26689f18e39918c66f6af01e0776fe1ddca8c97a69ba6236e7ae4bf"}
Sep 11 21:34:39.175959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.175875    2572 scope.go:117] "RemoveContainer" containerID="22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745"
Sep 11 21:34:39.177322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.177298    2572 generic.go:356] "Generic (PLEG): container finished" podID="45ce580e-31ac-439a-a988-f400877e1dbe" containerID="ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9" exitCode=0
Sep 11 21:34:39.177443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.177330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp" event={"ID":"45ce580e-31ac-439a-a988-f400877e1dbe","Type":"ContainerDied","Data":"ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9"}
Sep 11 21:34:39.177443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.177362    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"
Sep 11 21:34:39.177443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.177383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp" event={"ID":"45ce580e-31ac-439a-a988-f400877e1dbe","Type":"ContainerDied","Data":"fe6ff820dee5b312adf1caf9f42e8d2bc5d0a40dd72fee0115baffebdbaafab8"}
Sep 11 21:34:39.188052 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.188030    2572 scope.go:117] "RemoveContainer" containerID="22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745"
Sep 11 21:34:39.188526 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:34:39.188442    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745\": container with ID starting with 22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745 not found: ID does not exist" containerID="22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745"
Sep 11 21:34:39.188526 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.188485    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745"} err="failed to get container status \"22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745\": rpc error: code = NotFound desc = could not find container \"22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745\": container with ID starting with 22cc9cb2b8a58ae25b2f6fc5e9786d67f6e4a665cda315ea5e923e8d46935745 not found: ID does not exist"
Sep 11 21:34:39.188526 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.188508    2572 scope.go:117] "RemoveContainer" containerID="ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9"
Sep 11 21:34:39.198943 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.198916    2572 scope.go:117] "RemoveContainer" containerID="ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9"
Sep 11 21:34:39.199451 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:34:39.199419    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9\": container with ID starting with ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9 not found: ID does not exist" containerID="ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9"
Sep 11 21:34:39.199554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.199456    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9"} err="failed to get container status \"ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9\": rpc error: code = NotFound desc = could not find container \"ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9\": container with ID starting with ed3d9cbf39cd7563bd70a73d1b015ba0756fbd6c96b0ad5cc4471bc30a000cb9 not found: ID does not exist"
Sep 11 21:34:39.202273 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.202235    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"]
Sep 11 21:34:39.206444 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.206418    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0ddeac18-7f9959d988-72rnd"]
Sep 11 21:34:39.216450 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.216418    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"]
Sep 11 21:34:39.220694 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.220664    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0ddeac18-695b4b86bf-p2tzp"]
Sep 11 21:34:39.603555 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:39.603515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:40.144451 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:40.144418    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ce580e-31ac-439a-a988-f400877e1dbe" path="/var/lib/kubelet/pods/45ce580e-31ac-439a-a988-f400877e1dbe/volumes"
Sep 11 21:34:40.144836 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:40.144822    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed19225-94ff-498e-bb17-798573d9fd1d" path="/var/lib/kubelet/pods/5ed19225-94ff-498e-bb17-798573d9fd1d/volumes"
Sep 11 21:34:40.324526 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:40.324488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:41.300815 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:41.300777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:42.201078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:42.201041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:43.099375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:43.099339    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:43.099585 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:43.099422    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:43.112218 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:43.112190    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:43.213911 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:43.213881    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:34:44.432922 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:44.432888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:44.490995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:44.490957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:44.707796 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:44.707702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:45.048137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:45.048097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:45.149895 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:45.149855    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:45.273414 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:45.273384    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:47.993104 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993065    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"]
Sep 11 21:34:47.993612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993596    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ce580e-31ac-439a-a988-f400877e1dbe" containerName="payload-processing"
Sep 11 21:34:47.993612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993613    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ce580e-31ac-439a-a988-f400877e1dbe" containerName="payload-processing"
Sep 11 21:34:47.993692 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed19225-94ff-498e-bb17-798573d9fd1d" containerName="maas-api"
Sep 11 21:34:47.993692 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993638    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed19225-94ff-498e-bb17-798573d9fd1d" containerName="maas-api"
Sep 11 21:34:47.993754 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993726    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed19225-94ff-498e-bb17-798573d9fd1d" containerName="maas-api"
Sep 11 21:34:47.993754 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.993735    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ce580e-31ac-439a-a988-f400877e1dbe" containerName="payload-processing"
Sep 11 21:34:47.996840 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:47.996825    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.000723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.000694    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-85f1ab\"/\"noten-model-85f1ab-kserve-self-signed-certs\""
Sep 11 21:34:48.000913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.000694    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-85f1ab\"/\"openshift-service-ca.crt\""
Sep 11 21:34:48.000913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.000759    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-85f1ab\"/\"default-dockercfg-8wsqb\""
Sep 11 21:34:48.000913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.000759    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-85f1ab\"/\"kube-root-ca.crt\""
Sep 11 21:34:48.006449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.006421    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"]
Sep 11 21:34:48.032858 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.032827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-dshm\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.033033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.032868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-tmp-dir\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.033033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.032894    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-model-cache\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.033033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.032941    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2984\" (UniqueName: \"kubernetes.io/projected/72748224-6698-4c1b-9f09-cb928b615904-kube-api-access-h2984\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.033033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.032967    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-home\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.033033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.032985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72748224-6698-4c1b-9f09-cb928b615904-tls-certs\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.096539 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.096497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:48.133830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.133792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2984\" (UniqueName: \"kubernetes.io/projected/72748224-6698-4c1b-9f09-cb928b615904-kube-api-access-h2984\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.133844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-home\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.133873    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72748224-6698-4c1b-9f09-cb928b615904-tls-certs\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.133957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-dshm\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.133985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-tmp-dir\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134027 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.134016    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-model-cache\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.134345    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-home\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134457 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.134429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-model-cache\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.134684 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.134657    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-tmp-dir\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.136352 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.136320    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-dshm\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.136464 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.136452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72748224-6698-4c1b-9f09-cb928b615904-tls-certs\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.142093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.142067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2984\" (UniqueName: \"kubernetes.io/projected/72748224-6698-4c1b-9f09-cb928b615904-kube-api-access-h2984\") pod \"noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") " pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.307970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.307930    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:48.584639 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:48.584607    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"]
Sep 11 21:34:48.586440 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:34:48.586407    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72748224_6698_4c1b_9f09_cb928b615904.slice/crio-b7f69cc0a7bd3068b898fadbf2708f8c292c0198528e43b713e8178578696263 WatchSource:0}: Error finding container b7f69cc0a7bd3068b898fadbf2708f8c292c0198528e43b713e8178578696263: Status 404 returned error can't find the container with id b7f69cc0a7bd3068b898fadbf2708f8c292c0198528e43b713e8178578696263
Sep 11 21:34:49.239702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:49.239658    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt" event={"ID":"72748224-6698-4c1b-9f09-cb928b615904","Type":"ContainerStarted","Data":"93eeee70441f15a1760be2a256b0313c0b6c309bcce2ea0e1d73ac72c860335e"}
Sep 11 21:34:49.240093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:49.239712    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt" event={"ID":"72748224-6698-4c1b-9f09-cb928b615904","Type":"ContainerStarted","Data":"b7f69cc0a7bd3068b898fadbf2708f8c292c0198528e43b713e8178578696263"}
Sep 11 21:34:49.263351 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:49.263296    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt" podStartSLOduration=2.263273579 podStartE2EDuration="2.263273579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:49.259584681 +0000 UTC m=+1051.571810047" watchObservedRunningTime="2026-09-11 21:34:49.263273579 +0000 UTC m=+1051.575498945"
Sep 11 21:34:51.148523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:51.148484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:51.256866 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:51.256776    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:51.349893 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:51.349855    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:51.511844 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:51.511805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:53.639540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:53.639500    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:53.740482 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:53.740442    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:55.785009 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:55.784970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:57.350511 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:57.350449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:57.413458 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:57.413425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:57.805059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:57.805020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:58.277972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.277936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:58.308842 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.308809    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:58.309038 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.308854    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:58.321723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.321693    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:34:58.398564 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.398519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:58.607305 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.607204    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:58.864216 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:58.864124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:59.302402 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:59.302366    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:59.312511 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:34:59.312485    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:35:01.459032 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:01.458996    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:02.235602 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:02.235553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:02.329995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:02.329961    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:03.188375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:03.188329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:03.986749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:03.986711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:04.687359 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:04.687326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:05.480704 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.480672    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"]
Sep 11 21:35:05.485772 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.485749    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.488080 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.488058    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-ad5be0-serving-cert\""
Sep 11 21:35:05.492833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.492806    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"]
Sep 11 21:35:05.512485 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.512453    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:05.575708 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.575666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:05.614025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.613982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckr5r\" (UniqueName: \"kubernetes.io/projected/85b3a4a0-e246-49f5-86ed-d04d8811f016-kube-api-access-ckr5r\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.614230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.614049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.614230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.614074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b3a4a0-e246-49f5-86ed-d04d8811f016-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.614230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.614095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.675751 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.675712    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:05.715599 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.715562    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckr5r\" (UniqueName: \"kubernetes.io/projected/85b3a4a0-e246-49f5-86ed-d04d8811f016-kube-api-access-ckr5r\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.716064 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.715619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.716064 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.715649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b3a4a0-e246-49f5-86ed-d04d8811f016-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.716064 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.715667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.716495 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.716472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b3a4a0-e246-49f5-86ed-d04d8811f016-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.718058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.718030    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.718162 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.718094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.723376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.723352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckr5r\" (UniqueName: \"kubernetes.io/projected/85b3a4a0-e246-49f5-86ed-d04d8811f016-kube-api-access-ckr5r\") pod \"maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.800311 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.800267    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:05.990683 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:05.990650    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.076992 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:06.076965    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"]
Sep 11 21:35:06.078093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:06.078054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.079429 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:35:06.079407    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b3a4a0_e246_49f5_86ed_d04d8811f016.slice/crio-0170fcf4ae14733c5c8069f91c247692db325e827ec1f987855efa3e2ab8115f WatchSource:0}: Error finding container 0170fcf4ae14733c5c8069f91c247692db325e827ec1f987855efa3e2ab8115f: Status 404 returned error can't find the container with id 0170fcf4ae14733c5c8069f91c247692db325e827ec1f987855efa3e2ab8115f
Sep 11 21:35:06.080721 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:06.080705    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:35:06.342749 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:06.342659    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw" event={"ID":"85b3a4a0-e246-49f5-86ed-d04d8811f016","Type":"ContainerStarted","Data":"0170fcf4ae14733c5c8069f91c247692db325e827ec1f987855efa3e2ab8115f"}
Sep 11 21:35:07.349941 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:07.349904    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw" event={"ID":"85b3a4a0-e246-49f5-86ed-d04d8811f016","Type":"ContainerStarted","Data":"aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9"}
Sep 11 21:35:07.350387 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:07.350046    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:07.371806 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:07.371748    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw" podStartSLOduration=2.009184043 podStartE2EDuration="2.371732548s" totalImagesPullingTime="362.548505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:07.369069013 +0000 UTC m=+1069.681294378" watchObservedRunningTime="2026-09-11 21:35:07.371732548 +0000 UTC m=+1069.683957913"
Sep 11 21:35:13.361927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:13.361843    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:35:17.311159 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:17.311119    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:23.296588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:23.296534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:23.533521 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:23.533486    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:23.658557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:23.658475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:25.195904 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:25.195868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:26.371906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:26.371852    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:26.379833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:26.379807    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"]
Sep 11 21:35:26.471730 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:26.471689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:27.787424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:27.787381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:28.613221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:28.613184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:28.712880 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:28.712846    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:29.289365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:29.289333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:30.067439 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:30.067395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:30.814017 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:30.813975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:31.708131 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:31.708092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:32.242979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:32.242942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:32.558603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:32.558564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:32.893041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:32.892950    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:33.181588 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:33.181499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:35.006722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:35.006684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:35.482702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:35.482586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:35.594641 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:35.594606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:35.691911 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:35.691867    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:35.792618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:35.792578    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:36.475367 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:36.475331    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:37.147677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:37.147640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:38.004549 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:38.004511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:38.672456 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:38.672401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:39.469735 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.469702    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"]
Sep 11 21:35:39.474467 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.474443    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.477322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.477302    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-408219-serving-cert\""
Sep 11 21:35:39.480973 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.480943    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"]
Sep 11 21:35:39.504444 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.504399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:39.565848 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.565812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7qh\" (UniqueName: \"kubernetes.io/projected/cc1a91b6-5843-4592-aacd-a122a9ad94c0-kube-api-access-zw7qh\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.565848 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.565851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.566060 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.565871    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1a91b6-5843-4592-aacd-a122a9ad94c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.566060 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.566002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.596301 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.596241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:39.667461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.667428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7qh\" (UniqueName: \"kubernetes.io/projected/cc1a91b6-5843-4592-aacd-a122a9ad94c0-kube-api-access-zw7qh\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.667461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.667465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.667789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.667484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1a91b6-5843-4592-aacd-a122a9ad94c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.667789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.667555    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.667789 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:39.667712    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-serving-cert: secret "maas-api-e2e-shared-b-w2-408219-serving-cert" not found
Sep 11 21:35:39.667789 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:39.667789    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls podName:cc1a91b6-5843-4592-aacd-a122a9ad94c0 nodeName:}" failed. No retries permitted until 2026-09-11 21:35:40.167765141 +0000 UTC m=+1102.479990503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls") pod "maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" (UID: "cc1a91b6-5843-4592-aacd-a122a9ad94c0") : secret "maas-api-e2e-shared-b-w2-408219-serving-cert" not found
Sep 11 21:35:39.668493 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.668464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1a91b6-5843-4592-aacd-a122a9ad94c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.670387 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.670362    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.676771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.676748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7qh\" (UniqueName: \"kubernetes.io/projected/cc1a91b6-5843-4592-aacd-a122a9ad94c0-kube-api-access-zw7qh\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:39.779768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:39.779733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:40.061288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.061179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:40.139829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.139788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:40.171761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.171729    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:40.174135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.174108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:40.387715 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.387632    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:40.497937 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.497904    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:40.669227 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:40.669198    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"]
Sep 11 21:35:40.670933 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:35:40.670909    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1a91b6_5843_4592_aacd_a122a9ad94c0.slice/crio-c0f0128dad871bb5b53acb685a4702b89e764beeba287edfeacaf68cacab9680 WatchSource:0}: Error finding container c0f0128dad871bb5b53acb685a4702b89e764beeba287edfeacaf68cacab9680: Status 404 returned error can't find the container with id c0f0128dad871bb5b53acb685a4702b89e764beeba287edfeacaf68cacab9680
Sep 11 21:35:41.393619 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.393576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:41.399540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.399510    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt" podUID="72748224-6698-4c1b-9f09-cb928b615904" containerName="main" containerID="cri-o://93eeee70441f15a1760be2a256b0313c0b6c309bcce2ea0e1d73ac72c860335e" gracePeriod=45
Sep 11 21:35:41.558051 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.558021    2572 generic.go:356] "Generic (PLEG): container finished" podID="72748224-6698-4c1b-9f09-cb928b615904" containerID="93eeee70441f15a1760be2a256b0313c0b6c309bcce2ea0e1d73ac72c860335e" exitCode=0
Sep 11 21:35:41.558470 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.558096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt" event={"ID":"72748224-6698-4c1b-9f09-cb928b615904","Type":"ContainerDied","Data":"93eeee70441f15a1760be2a256b0313c0b6c309bcce2ea0e1d73ac72c860335e"}
Sep 11 21:35:41.559899 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.559875    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" event={"ID":"cc1a91b6-5843-4592-aacd-a122a9ad94c0","Type":"ContainerStarted","Data":"203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8"}
Sep 11 21:35:41.560029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.559916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" event={"ID":"cc1a91b6-5843-4592-aacd-a122a9ad94c0","Type":"ContainerStarted","Data":"c0f0128dad871bb5b53acb685a4702b89e764beeba287edfeacaf68cacab9680"}
Sep 11 21:35:41.560029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.559980    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:41.580033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.579983    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" podStartSLOduration=2.268732457 podStartE2EDuration="2.579961507s" totalImagesPullingTime="311.22905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:41.579381256 +0000 UTC m=+1103.891606621" watchObservedRunningTime="2026-09-11 21:35:41.579961507 +0000 UTC m=+1103.892186873"
Sep 11 21:35:41.665591 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.665567    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:35:41.790142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790108    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-model-cache\") pod \"72748224-6698-4c1b-9f09-cb928b615904\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") "
Sep 11 21:35:41.790142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790146    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2984\" (UniqueName: \"kubernetes.io/projected/72748224-6698-4c1b-9f09-cb928b615904-kube-api-access-h2984\") pod \"72748224-6698-4c1b-9f09-cb928b615904\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") "
Sep 11 21:35:41.790429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790185    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-dshm\") pod \"72748224-6698-4c1b-9f09-cb928b615904\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") "
Sep 11 21:35:41.790429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790228    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72748224-6698-4c1b-9f09-cb928b615904-tls-certs\") pod \"72748224-6698-4c1b-9f09-cb928b615904\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") "
Sep 11 21:35:41.790429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790289    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-tmp-dir\") pod \"72748224-6698-4c1b-9f09-cb928b615904\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") "
Sep 11 21:35:41.790429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790339    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-home\") pod \"72748224-6698-4c1b-9f09-cb928b615904\" (UID: \"72748224-6698-4c1b-9f09-cb928b615904\") "
Sep 11 21:35:41.790658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790460    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-model-cache" (OuterVolumeSpecName: "model-cache") pod "72748224-6698-4c1b-9f09-cb928b615904" (UID: "72748224-6698-4c1b-9f09-cb928b615904"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:41.790712 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790669    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72748224-6698-4c1b-9f09-cb928b615904" (UID: "72748224-6698-4c1b-9f09-cb928b615904"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:41.790763 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790749    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-home" (OuterVolumeSpecName: "home") pod "72748224-6698-4c1b-9f09-cb928b615904" (UID: "72748224-6698-4c1b-9f09-cb928b615904"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:41.790817 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790754    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-model-cache\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:41.790817 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.790782    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-tmp-dir\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:41.792592 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.792565    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-dshm" (OuterVolumeSpecName: "dshm") pod "72748224-6698-4c1b-9f09-cb928b615904" (UID: "72748224-6698-4c1b-9f09-cb928b615904"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:41.792720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.792679    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72748224-6698-4c1b-9f09-cb928b615904-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72748224-6698-4c1b-9f09-cb928b615904" (UID: "72748224-6698-4c1b-9f09-cb928b615904"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:41.792720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.792693    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72748224-6698-4c1b-9f09-cb928b615904-kube-api-access-h2984" (OuterVolumeSpecName: "kube-api-access-h2984") pod "72748224-6698-4c1b-9f09-cb928b615904" (UID: "72748224-6698-4c1b-9f09-cb928b615904"). InnerVolumeSpecName "kube-api-access-h2984". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:41.892036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.892002    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72748224-6698-4c1b-9f09-cb928b615904-tls-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:41.892036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.892029    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-home\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:41.892036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.892037    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2984\" (UniqueName: \"kubernetes.io/projected/72748224-6698-4c1b-9f09-cb928b615904-kube-api-access-h2984\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:41.892036 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:41.892045    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72748224-6698-4c1b-9f09-cb928b615904-dshm\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:42.115351 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:42.115319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:42.567387 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:42.567354    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"
Sep 11 21:35:42.567846 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:42.567398    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt" event={"ID":"72748224-6698-4c1b-9f09-cb928b615904","Type":"ContainerDied","Data":"b7f69cc0a7bd3068b898fadbf2708f8c292c0198528e43b713e8178578696263"}
Sep 11 21:35:42.567846 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:42.567445    2572 scope.go:117] "RemoveContainer" containerID="93eeee70441f15a1760be2a256b0313c0b6c309bcce2ea0e1d73ac72c860335e"
Sep 11 21:35:42.584565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:42.584262    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"]
Sep 11 21:35:42.587680 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:42.587655    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-85f1ab/noten-model-85f1ab-kserve-7cbbd66fc9-d9gvt"]
Sep 11 21:35:44.144583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:44.144550    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72748224-6698-4c1b-9f09-cb928b615904" path="/var/lib/kubelet/pods/72748224-6698-4c1b-9f09-cb928b615904/volumes"
Sep 11 21:35:45.795903 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:45.795866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:46.352804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.352770    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"]
Sep 11 21:35:46.353073 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.353047    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" podUID="b750af2b-f06f-4c20-aae9-41acb379412f" containerName="maas-api" containerID="cri-o://9df7da36acebc64b34b8e8ab66048cca540b9a3196ee43adb04eb21e96036fb2" gracePeriod=30
Sep 11 21:35:46.381785 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.381730    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:46.413382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.413351    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"]
Sep 11 21:35:46.413611 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.413586    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz" podUID="7d31ad3f-a508-424b-886c-439d016c8f5c" containerName="payload-processing" containerID="cri-o://1faf451a57a9188e365df4d7fc61ceb3d562a671a03bc8bdaff60f1f6f5978f2" gracePeriod=30
Sep 11 21:35:46.479817 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.479782    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:46.576480 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.576371    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:46.596509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.596379    2572 generic.go:356] "Generic (PLEG): container finished" podID="b750af2b-f06f-4c20-aae9-41acb379412f" containerID="9df7da36acebc64b34b8e8ab66048cca540b9a3196ee43adb04eb21e96036fb2" exitCode=0
Sep 11 21:35:46.596509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.596447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" event={"ID":"b750af2b-f06f-4c20-aae9-41acb379412f","Type":"ContainerDied","Data":"9df7da36acebc64b34b8e8ab66048cca540b9a3196ee43adb04eb21e96036fb2"}
Sep 11 21:35:46.598101 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.598079    2572 generic.go:356] "Generic (PLEG): container finished" podID="7d31ad3f-a508-424b-886c-439d016c8f5c" containerID="1faf451a57a9188e365df4d7fc61ceb3d562a671a03bc8bdaff60f1f6f5978f2" exitCode=0
Sep 11 21:35:46.598175 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.598105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz" event={"ID":"7d31ad3f-a508-424b-886c-439d016c8f5c","Type":"ContainerDied","Data":"1faf451a57a9188e365df4d7fc61ceb3d562a671a03bc8bdaff60f1f6f5978f2"}
Sep 11 21:35:46.635753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.635717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:46.670155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.670131    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:35:46.701045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.701016    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:35:46.849794 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.849761    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-metrics-certs\") pod \"b750af2b-f06f-4c20-aae9-41acb379412f\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") "
Sep 11 21:35:46.850289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.849818    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b750af2b-f06f-4c20-aae9-41acb379412f-openshift-service-ca\") pod \"b750af2b-f06f-4c20-aae9-41acb379412f\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") "
Sep 11 21:35:46.850289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.849876    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d31ad3f-a508-424b-886c-439d016c8f5c-plugins-config-volume\") pod \"7d31ad3f-a508-424b-886c-439d016c8f5c\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") "
Sep 11 21:35:46.850289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.849965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls\") pod \"b750af2b-f06f-4c20-aae9-41acb379412f\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") "
Sep 11 21:35:46.850289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.850006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flfcl\" (UniqueName: \"kubernetes.io/projected/7d31ad3f-a508-424b-886c-439d016c8f5c-kube-api-access-flfcl\") pod \"7d31ad3f-a508-424b-886c-439d016c8f5c\" (UID: \"7d31ad3f-a508-424b-886c-439d016c8f5c\") "
Sep 11 21:35:46.850289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.850033    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qv2m\" (UniqueName: \"kubernetes.io/projected/b750af2b-f06f-4c20-aae9-41acb379412f-kube-api-access-7qv2m\") pod \"b750af2b-f06f-4c20-aae9-41acb379412f\" (UID: \"b750af2b-f06f-4c20-aae9-41acb379412f\") "
Sep 11 21:35:46.850289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.850211    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b750af2b-f06f-4c20-aae9-41acb379412f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b750af2b-f06f-4c20-aae9-41acb379412f" (UID: "b750af2b-f06f-4c20-aae9-41acb379412f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:46.850533 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.850312    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d31ad3f-a508-424b-886c-439d016c8f5c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d31ad3f-a508-424b-886c-439d016c8f5c" (UID: "7d31ad3f-a508-424b-886c-439d016c8f5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:46.850533 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.850442    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b750af2b-f06f-4c20-aae9-41acb379412f-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:46.850533 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.850464    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d31ad3f-a508-424b-886c-439d016c8f5c-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:46.852028 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.852007    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b750af2b-f06f-4c20-aae9-41acb379412f" (UID: "b750af2b-f06f-4c20-aae9-41acb379412f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:46.852129 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.852056    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b750af2b-f06f-4c20-aae9-41acb379412f-kube-api-access-7qv2m" (OuterVolumeSpecName: "kube-api-access-7qv2m") pod "b750af2b-f06f-4c20-aae9-41acb379412f" (UID: "b750af2b-f06f-4c20-aae9-41acb379412f"). InnerVolumeSpecName "kube-api-access-7qv2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:46.852484 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.852466    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b750af2b-f06f-4c20-aae9-41acb379412f" (UID: "b750af2b-f06f-4c20-aae9-41acb379412f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:46.852533 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.852467    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d31ad3f-a508-424b-886c-439d016c8f5c-kube-api-access-flfcl" (OuterVolumeSpecName: "kube-api-access-flfcl") pod "7d31ad3f-a508-424b-886c-439d016c8f5c" (UID: "7d31ad3f-a508-424b-886c-439d016c8f5c"). InnerVolumeSpecName "kube-api-access-flfcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:46.945565 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.945464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:46.951692 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.951669    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:46.951769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.951695    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flfcl\" (UniqueName: \"kubernetes.io/projected/7d31ad3f-a508-424b-886c-439d016c8f5c-kube-api-access-flfcl\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:46.951769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.951705    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qv2m\" (UniqueName: \"kubernetes.io/projected/b750af2b-f06f-4c20-aae9-41acb379412f-kube-api-access-7qv2m\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:46.951769 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:46.951715    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b750af2b-f06f-4c20-aae9-41acb379412f-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:47.049340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.049302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:47.573921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.573893    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:35:47.606331 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.606304    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"
Sep 11 21:35:47.606507 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.606295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb" event={"ID":"b750af2b-f06f-4c20-aae9-41acb379412f","Type":"ContainerDied","Data":"09ba7455f279d2cdf8eae7db2f226656176be1d076699480fb4a6fd591ef97c0"}
Sep 11 21:35:47.606507 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.606454    2572 scope.go:117] "RemoveContainer" containerID="9df7da36acebc64b34b8e8ab66048cca540b9a3196ee43adb04eb21e96036fb2"
Sep 11 21:35:47.608531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.608503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz" event={"ID":"7d31ad3f-a508-424b-886c-439d016c8f5c","Type":"ContainerDied","Data":"f617ee623216db1a287c9db06fbd3f430614733c14dac52cb83f1727d35fd826"}
Sep 11 21:35:47.608720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.608685    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"
Sep 11 21:35:47.621393 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.621369    2572 scope.go:117] "RemoveContainer" containerID="1faf451a57a9188e365df4d7fc61ceb3d562a671a03bc8bdaff60f1f6f5978f2"
Sep 11 21:35:47.639058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.639005    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"]
Sep 11 21:35:47.641801 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.641777    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1a1e3a-74d98686c4-dkrnb"]
Sep 11 21:35:47.651421 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.651398    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"]
Sep 11 21:35:47.655678 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.655657    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1a1e3a-6bd8c5b7cc-vz6vz"]
Sep 11 21:35:47.814322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:47.814272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:48.145959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:48.145927    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d31ad3f-a508-424b-886c-439d016c8f5c" path="/var/lib/kubelet/pods/7d31ad3f-a508-424b-886c-439d016c8f5c/volumes"
Sep 11 21:35:48.146450 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:48.146347    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b750af2b-f06f-4c20-aae9-41acb379412f" path="/var/lib/kubelet/pods/b750af2b-f06f-4c20-aae9-41acb379412f/volumes"
Sep 11 21:35:48.608511 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:48.608470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:49.296602 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:49.296568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:49.982419 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:49.982376    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:50.323699 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:50.323660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:50.784958 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:50.784905    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:51.069613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.069517    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7807-8fe7b1"]
Sep 11 21:35:51.070073 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070053    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b750af2b-f06f-4c20-aae9-41acb379412f" containerName="maas-api"
Sep 11 21:35:51.070160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070076    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b750af2b-f06f-4c20-aae9-41acb379412f" containerName="maas-api"
Sep 11 21:35:51.070160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070089    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72748224-6698-4c1b-9f09-cb928b615904" containerName="main"
Sep 11 21:35:51.070160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070097    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="72748224-6698-4c1b-9f09-cb928b615904" containerName="main"
Sep 11 21:35:51.070160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070123    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d31ad3f-a508-424b-886c-439d016c8f5c" containerName="payload-processing"
Sep 11 21:35:51.070160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070132    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d31ad3f-a508-424b-886c-439d016c8f5c" containerName="payload-processing"
Sep 11 21:35:51.070461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070246    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d31ad3f-a508-424b-886c-439d016c8f5c" containerName="payload-processing"
Sep 11 21:35:51.070461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070282    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b750af2b-f06f-4c20-aae9-41acb379412f" containerName="maas-api"
Sep 11 21:35:51.070461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.070292    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="72748224-6698-4c1b-9f09-cb928b615904" containerName="main"
Sep 11 21:35:51.075176 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.075145    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:51.077764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.077734    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ns82b\""
Sep 11 21:35:51.080049 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.079998    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-8fe7b1"]
Sep 11 21:35:51.091907 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.091876    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8l5m\" (UniqueName: \"kubernetes.io/projected/cb0cc70d-b03c-45bf-ac81-8e4c02271625-kube-api-access-q8l5m\") pod \"test-curl-7807-8fe7b1\" (UID: \"cb0cc70d-b03c-45bf-ac81-8e4c02271625\") " pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:51.193092 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.193051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8l5m\" (UniqueName: \"kubernetes.io/projected/cb0cc70d-b03c-45bf-ac81-8e4c02271625-kube-api-access-q8l5m\") pod \"test-curl-7807-8fe7b1\" (UID: \"cb0cc70d-b03c-45bf-ac81-8e4c02271625\") " pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:51.201079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.201043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8l5m\" (UniqueName: \"kubernetes.io/projected/cb0cc70d-b03c-45bf-ac81-8e4c02271625-kube-api-access-q8l5m\") pod \"test-curl-7807-8fe7b1\" (UID: \"cb0cc70d-b03c-45bf-ac81-8e4c02271625\") " pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:51.386370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.386285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:51.514956 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.514922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:51.666705 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:51.666678    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-8fe7b1"]
Sep 11 21:35:51.667820 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:35:51.667798    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb0cc70d_b03c_45bf_ac81_8e4c02271625.slice/crio-526aaddae8039dcd2d9d59b0d3681832bebab160edc8330d004fac0ef92d72e6 WatchSource:0}: Error finding container 526aaddae8039dcd2d9d59b0d3681832bebab160edc8330d004fac0ef92d72e6: Status 404 returned error can't find the container with id 526aaddae8039dcd2d9d59b0d3681832bebab160edc8330d004fac0ef92d72e6
Sep 11 21:35:52.595988 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:52.595952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:52.641637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:52.641594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-8fe7b1" event={"ID":"cb0cc70d-b03c-45bf-ac81-8e4c02271625","Type":"ContainerStarted","Data":"dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede"}
Sep 11 21:35:52.641637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:52.641634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-8fe7b1" event={"ID":"cb0cc70d-b03c-45bf-ac81-8e4c02271625","Type":"ContainerStarted","Data":"526aaddae8039dcd2d9d59b0d3681832bebab160edc8330d004fac0ef92d72e6"}
Sep 11 21:35:52.657627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:52.657573    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7807-8fe7b1" podStartSLOduration=1.6575564470000002 podStartE2EDuration="1.657556447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:52.656543808 +0000 UTC m=+1114.968769177" watchObservedRunningTime="2026-09-11 21:35:52.657556447 +0000 UTC m=+1114.969781810"
Sep 11 21:35:53.284280 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.284217    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7807-8fe7b1"]
Sep 11 21:35:53.288431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.288393    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7807-8fe7b1"]
Sep 11 21:35:53.329529 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.329437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:53.416988 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.416948    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7807-3d8b1b"]
Sep 11 21:35:53.417458 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.417443    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" containerName="test-curl-7807-8fe7b1"
Sep 11 21:35:53.417520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.417460    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" containerName="test-curl-7807-8fe7b1"
Sep 11 21:35:53.417571 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.417560    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" containerName="test-curl-7807-8fe7b1"
Sep 11 21:35:53.420943 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.420923    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:53.426667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.426636    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-3d8b1b"]
Sep 11 21:35:53.513711 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.513676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:53.520071 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.520051    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbt5\" (UniqueName: \"kubernetes.io/projected/46a6c841-4d81-4ebb-a62f-73d9ab83db77-kube-api-access-7hbt5\") pod \"test-curl-7807-3d8b1b\" (UID: \"46a6c841-4d81-4ebb-a62f-73d9ab83db77\") " pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:53.614096 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.614005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:53.621153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.621130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbt5\" (UniqueName: \"kubernetes.io/projected/46a6c841-4d81-4ebb-a62f-73d9ab83db77-kube-api-access-7hbt5\") pod \"test-curl-7807-3d8b1b\" (UID: \"46a6c841-4d81-4ebb-a62f-73d9ab83db77\") " pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:53.630026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.629992    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbt5\" (UniqueName: \"kubernetes.io/projected/46a6c841-4d81-4ebb-a62f-73d9ab83db77-kube-api-access-7hbt5\") pod \"test-curl-7807-3d8b1b\" (UID: \"46a6c841-4d81-4ebb-a62f-73d9ab83db77\") " pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:53.648165 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:53.648139    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7807-8fe7b1" container="test-curl-7807-8fe7b1"
Sep 11 21:35:53.732695 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.732662    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:53.781734 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:53.781687    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:54.036413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:54.036386    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-3d8b1b"]
Sep 11 21:35:54.038367 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:35:54.038338    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46a6c841_4d81_4ebb_a62f_73d9ab83db77.slice/crio-fe3ad70a8ac5a80cbf811d5190301bbf1a2dff184f71e7dda94ff9c602660f90 WatchSource:0}: Error finding container fe3ad70a8ac5a80cbf811d5190301bbf1a2dff184f71e7dda94ff9c602660f90: Status 404 returned error can't find the container with id fe3ad70a8ac5a80cbf811d5190301bbf1a2dff184f71e7dda94ff9c602660f90
Sep 11 21:35:54.657278 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:54.657214    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-3d8b1b" event={"ID":"46a6c841-4d81-4ebb-a62f-73d9ab83db77","Type":"ContainerStarted","Data":"63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56"}
Sep 11 21:35:54.657278 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:54.657281    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-3d8b1b" event={"ID":"46a6c841-4d81-4ebb-a62f-73d9ab83db77","Type":"ContainerStarted","Data":"fe3ad70a8ac5a80cbf811d5190301bbf1a2dff184f71e7dda94ff9c602660f90"}
Sep 11 21:35:54.657831 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:54.657503    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7807-8fe7b1" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" containerName="test-curl-7807-8fe7b1" containerID="cri-o://dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede" gracePeriod=2
Sep 11 21:35:54.674288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:54.674171    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7807-3d8b1b" podStartSLOduration=1.6741533419999999 podStartE2EDuration="1.674153342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:54.672723674 +0000 UTC m=+1116.984949038" watchObservedRunningTime="2026-09-11 21:35:54.674153342 +0000 UTC m=+1116.986378707"
Sep 11 21:35:55.016954 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.016918    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:55.214473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.214418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:55.299321 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.299223    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7807-3d8b1b"]
Sep 11 21:35:55.305200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.305171    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7807-3d8b1b"]
Sep 11 21:35:55.432427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.432389    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7807-ea9765"]
Sep 11 21:35:55.432883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.432871    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" containerName="test-curl-7807-3d8b1b"
Sep 11 21:35:55.432931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.432886    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" containerName="test-curl-7807-3d8b1b"
Sep 11 21:35:55.432972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.432962    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" containerName="test-curl-7807-3d8b1b"
Sep 11 21:35:55.436318 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.436301    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:35:55.445710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.445684    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-ea9765"]
Sep 11 21:35:55.541262 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.541228    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bms\" (UniqueName: \"kubernetes.io/projected/44b05839-3465-406b-8347-50bdefee881a-kube-api-access-88bms\") pod \"test-curl-7807-ea9765\" (UID: \"44b05839-3465-406b-8347-50bdefee881a\") " pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:35:55.642031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.641997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88bms\" (UniqueName: \"kubernetes.io/projected/44b05839-3465-406b-8347-50bdefee881a-kube-api-access-88bms\") pod \"test-curl-7807-ea9765\" (UID: \"44b05839-3465-406b-8347-50bdefee881a\") " pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:35:55.649657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.649632    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bms\" (UniqueName: \"kubernetes.io/projected/44b05839-3465-406b-8347-50bdefee881a-kube-api-access-88bms\") pod \"test-curl-7807-ea9765\" (UID: \"44b05839-3465-406b-8347-50bdefee881a\") " pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:35:55.663980 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:55.663956    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7807-3d8b1b" container="test-curl-7807-3d8b1b"
Sep 11 21:35:55.748059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.748023    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:35:55.914888 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:55.914853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:56.022557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.022528    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-ea9765"]
Sep 11 21:35:56.023407 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:35:56.023383    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b05839_3465_406b_8347_50bdefee881a.slice/crio-51aace826575ca07bcadf431dd281a717449a48258793b1caa98bf75da42d621 WatchSource:0}: Error finding container 51aace826575ca07bcadf431dd281a717449a48258793b1caa98bf75da42d621: Status 404 returned error can't find the container with id 51aace826575ca07bcadf431dd281a717449a48258793b1caa98bf75da42d621
Sep 11 21:35:56.607788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.607728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:56.671046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.671015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-ea9765" event={"ID":"44b05839-3465-406b-8347-50bdefee881a","Type":"ContainerStarted","Data":"99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8"}
Sep 11 21:35:56.671436 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.671064    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-ea9765" event={"ID":"44b05839-3465-406b-8347-50bdefee881a","Type":"ContainerStarted","Data":"51aace826575ca07bcadf431dd281a717449a48258793b1caa98bf75da42d621"}
Sep 11 21:35:56.671436 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.671096    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7807-3d8b1b" podUID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" containerName="test-curl-7807-3d8b1b" containerID="cri-o://63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56" gracePeriod=2
Sep 11 21:35:56.688138 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.688087    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7807-ea9765" podStartSLOduration=1.688069752 podStartE2EDuration="1.688069752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:56.68449632 +0000 UTC m=+1118.996721687" watchObservedRunningTime="2026-09-11 21:35:56.688069752 +0000 UTC m=+1119.000295170"
Sep 11 21:35:56.850666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.850642    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:56.955771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.955681    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8l5m\" (UniqueName: \"kubernetes.io/projected/cb0cc70d-b03c-45bf-ac81-8e4c02271625-kube-api-access-q8l5m\") pod \"cb0cc70d-b03c-45bf-ac81-8e4c02271625\" (UID: \"cb0cc70d-b03c-45bf-ac81-8e4c02271625\") "
Sep 11 21:35:56.957827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:56.957793    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0cc70d-b03c-45bf-ac81-8e4c02271625-kube-api-access-q8l5m" (OuterVolumeSpecName: "kube-api-access-q8l5m") pod "cb0cc70d-b03c-45bf-ac81-8e4c02271625" (UID: "cb0cc70d-b03c-45bf-ac81-8e4c02271625"). InnerVolumeSpecName "kube-api-access-q8l5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:57.057318 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.057288    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8l5m\" (UniqueName: \"kubernetes.io/projected/cb0cc70d-b03c-45bf-ac81-8e4c02271625-kube-api-access-q8l5m\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:57.285307 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.285272    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7807-ea9765"]
Sep 11 21:35:57.292491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.292458    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7807-ea9765"]
Sep 11 21:35:57.420990 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.420952    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7807-776677"]
Sep 11 21:35:57.421539 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.421518    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b05839-3465-406b-8347-50bdefee881a" containerName="test-curl-7807-ea9765"
Sep 11 21:35:57.421539 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.421540    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b05839-3465-406b-8347-50bdefee881a" containerName="test-curl-7807-ea9765"
Sep 11 21:35:57.421696 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.421682    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b05839-3465-406b-8347-50bdefee881a" containerName="test-curl-7807-ea9765"
Sep 11 21:35:57.425016 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.424989    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-776677"
Sep 11 21:35:57.434493 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.434465    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-776677"]
Sep 11 21:35:57.455050 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.455015    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:57.461178 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.461148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddngn\" (UniqueName: \"kubernetes.io/projected/3651606a-0242-4cae-b812-db0eb3ffc142-kube-api-access-ddngn\") pod \"test-curl-7807-776677\" (UID: \"3651606a-0242-4cae-b812-db0eb3ffc142\") " pod="opendatahub/test-curl-7807-776677"
Sep 11 21:35:57.562351 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.562237    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddngn\" (UniqueName: \"kubernetes.io/projected/3651606a-0242-4cae-b812-db0eb3ffc142-kube-api-access-ddngn\") pod \"test-curl-7807-776677\" (UID: \"3651606a-0242-4cae-b812-db0eb3ffc142\") " pod="opendatahub/test-curl-7807-776677"
Sep 11 21:35:57.570727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.570695    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddngn\" (UniqueName: \"kubernetes.io/projected/3651606a-0242-4cae-b812-db0eb3ffc142-kube-api-access-ddngn\") pod \"test-curl-7807-776677\" (UID: \"3651606a-0242-4cae-b812-db0eb3ffc142\") " pod="opendatahub/test-curl-7807-776677"
Sep 11 21:35:57.678342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.678311    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" containerID="dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede" exitCode=137
Sep 11 21:35:57.678760 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.678352    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:57.678760 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.678413    2572 scope.go:117] "RemoveContainer" containerID="dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede"
Sep 11 21:35:57.678760 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:57.678643    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7807-ea9765" container="test-curl-7807-ea9765"
Sep 11 21:35:57.688412 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.688394    2572 scope.go:117] "RemoveContainer" containerID="dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede"
Sep 11 21:35:57.688747 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:57.688725    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede\": container with ID starting with dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede not found: ID does not exist" containerID="dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede"
Sep 11 21:35:57.688829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.688761    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede"} err="failed to get container status \"dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede\": rpc error: code = NotFound desc = could not find container \"dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede\": container with ID starting with dfa58fe3be1706ebbe85c00fb405fcc8610984bf41bc8bddb40c6b99f8198ede not found: ID does not exist"
Sep 11 21:35:57.690727 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:57.690703    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7807-8fe7b1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:57.736068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:57.736040    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-776677"
Sep 11 21:35:58.012593 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.012566    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7807-776677"]
Sep 11 21:35:58.014517 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:35:58.014477    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3651606a_0242_4cae_b812_db0eb3ffc142.slice/crio-15a0dd52cad37152cf323551036bc17a122edbe7059c1195a55946e077d85d7a WatchSource:0}: Error finding container 15a0dd52cad37152cf323551036bc17a122edbe7059c1195a55946e077d85d7a: Status 404 returned error can't find the container with id 15a0dd52cad37152cf323551036bc17a122edbe7059c1195a55946e077d85d7a
Sep 11 21:35:58.142266 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:58.142221    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7807-8fe7b1\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" pod="opendatahub/test-curl-7807-8fe7b1"
Sep 11 21:35:58.143754 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.143731    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0cc70d-b03c-45bf-ac81-8e4c02271625" path="/var/lib/kubelet/pods/cb0cc70d-b03c-45bf-ac81-8e4c02271625/volumes"
Sep 11 21:35:58.195675 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.195641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:58.687322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.687285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-776677" event={"ID":"3651606a-0242-4cae-b812-db0eb3ffc142","Type":"ContainerStarted","Data":"3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9"}
Sep 11 21:35:58.687684 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.687339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7807-776677" event={"ID":"3651606a-0242-4cae-b812-db0eb3ffc142","Type":"ContainerStarted","Data":"15a0dd52cad37152cf323551036bc17a122edbe7059c1195a55946e077d85d7a"}
Sep 11 21:35:58.688722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.688691    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7807-ea9765" podUID="44b05839-3465-406b-8347-50bdefee881a" containerName="test-curl-7807-ea9765" containerID="cri-o://99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8" gracePeriod=2
Sep 11 21:35:58.702196 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.702149    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7807-776677" podStartSLOduration=1.702134091 podStartE2EDuration="1.702134091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:58.699784547 +0000 UTC m=+1121.012009914" watchObservedRunningTime="2026-09-11 21:35:58.702134091 +0000 UTC m=+1121.014359457"
Sep 11 21:35:58.853755 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.853730    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:58.976547 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.976467    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hbt5\" (UniqueName: \"kubernetes.io/projected/46a6c841-4d81-4ebb-a62f-73d9ab83db77-kube-api-access-7hbt5\") pod \"46a6c841-4d81-4ebb-a62f-73d9ab83db77\" (UID: \"46a6c841-4d81-4ebb-a62f-73d9ab83db77\") "
Sep 11 21:35:58.978421 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:58.978396    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a6c841-4d81-4ebb-a62f-73d9ab83db77-kube-api-access-7hbt5" (OuterVolumeSpecName: "kube-api-access-7hbt5") pod "46a6c841-4d81-4ebb-a62f-73d9ab83db77" (UID: "46a6c841-4d81-4ebb-a62f-73d9ab83db77"). InnerVolumeSpecName "kube-api-access-7hbt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:59.075829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.075792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:59.077751 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.077728    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hbt5\" (UniqueName: \"kubernetes.io/projected/46a6c841-4d81-4ebb-a62f-73d9ab83db77-kube-api-access-7hbt5\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:35:59.320157 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.320123    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7807-776677"]
Sep 11 21:35:59.329685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.329655    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7807-776677"]
Sep 11 21:35:59.695467 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.695375    2572 generic.go:356] "Generic (PLEG): container finished" podID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" containerID="63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56" exitCode=137
Sep 11 21:35:59.695467 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.695420    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:35:59.695467 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.695425    2572 scope.go:117] "RemoveContainer" containerID="63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56"
Sep 11 21:35:59.695946 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:59.695808    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7807-776677" container="test-curl-7807-776677"
Sep 11 21:35:59.705445 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.705429    2572 scope.go:117] "RemoveContainer" containerID="63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56"
Sep 11 21:35:59.705710 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:59.705690    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56\": container with ID starting with 63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56 not found: ID does not exist" containerID="63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56"
Sep 11 21:35:59.705781 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:35:59.705726    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56"} err="failed to get container status \"63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56\": rpc error: code = NotFound desc = could not find container \"63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56\": container with ID starting with 63c5795bb053ae99a86e841321b19fc0b64c02cc6c2cf80588078a8645798f56 not found: ID does not exist"
Sep 11 21:35:59.706019 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:35:59.705997    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7807-3d8b1b\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" pod="opendatahub/test-curl-7807-3d8b1b"
Sep 11 21:36:00.005613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.005574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:00.144574 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.144535    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46a6c841-4d81-4ebb-a62f-73d9ab83db77" path="/var/lib/kubelet/pods/46a6c841-4d81-4ebb-a62f-73d9ab83db77/volumes"
Sep 11 21:36:00.284577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.284468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:00.467481 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.467442    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:00.560757 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.560664    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:00.702745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.702709    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7807-776677" podUID="3651606a-0242-4cae-b812-db0eb3ffc142" containerName="test-curl-7807-776677" containerID="cri-o://3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9" gracePeriod=2
Sep 11 21:36:00.865147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.865120    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:36:00.997569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.997536    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88bms\" (UniqueName: \"kubernetes.io/projected/44b05839-3465-406b-8347-50bdefee881a-kube-api-access-88bms\") pod \"44b05839-3465-406b-8347-50bdefee881a\" (UID: \"44b05839-3465-406b-8347-50bdefee881a\") "
Sep 11 21:36:00.999654 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:00.999622    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b05839-3465-406b-8347-50bdefee881a-kube-api-access-88bms" (OuterVolumeSpecName: "kube-api-access-88bms") pod "44b05839-3465-406b-8347-50bdefee881a" (UID: "44b05839-3465-406b-8347-50bdefee881a"). InnerVolumeSpecName "kube-api-access-88bms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:01.099371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:01.099285    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88bms\" (UniqueName: \"kubernetes.io/projected/44b05839-3465-406b-8347-50bdefee881a-kube-api-access-88bms\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:36:01.709727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:01.709694    2572 generic.go:356] "Generic (PLEG): container finished" podID="44b05839-3465-406b-8347-50bdefee881a" containerID="99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8" exitCode=137
Sep 11 21:36:01.710144 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:01.709734    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:36:01.710144 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:01.709787    2572 scope.go:117] "RemoveContainer" containerID="99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8"
Sep 11 21:36:01.719747 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:01.719730    2572 scope.go:117] "RemoveContainer" containerID="99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8"
Sep 11 21:36:01.720002 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:01.719985    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8\": container with ID starting with 99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8 not found: ID does not exist" containerID="99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8"
Sep 11 21:36:01.720046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:01.720012    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8"} err="failed to get container status \"99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8\": rpc error: code = NotFound desc = could not find container \"99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8\": container with ID starting with 99ed3865941b3003050e36efbd34a77e827d23512070d1fff7bface992a0eed8 not found: ID does not exist"
Sep 11 21:36:01.720589 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:01.720568    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7807-ea9765\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="44b05839-3465-406b-8347-50bdefee881a" pod="opendatahub/test-curl-7807-ea9765"
Sep 11 21:36:02.143913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:02.143885    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b05839-3465-406b-8347-50bdefee881a" path="/var/lib/kubelet/pods/44b05839-3465-406b-8347-50bdefee881a/volumes"
Sep 11 21:36:02.889807 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:02.889784    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-776677"
Sep 11 21:36:03.018864 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.018833    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddngn\" (UniqueName: \"kubernetes.io/projected/3651606a-0242-4cae-b812-db0eb3ffc142-kube-api-access-ddngn\") pod \"3651606a-0242-4cae-b812-db0eb3ffc142\" (UID: \"3651606a-0242-4cae-b812-db0eb3ffc142\") "
Sep 11 21:36:03.020990 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.020959    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3651606a-0242-4cae-b812-db0eb3ffc142-kube-api-access-ddngn" (OuterVolumeSpecName: "kube-api-access-ddngn") pod "3651606a-0242-4cae-b812-db0eb3ffc142" (UID: "3651606a-0242-4cae-b812-db0eb3ffc142"). InnerVolumeSpecName "kube-api-access-ddngn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:03.111850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.111816    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:03.120031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.120004    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddngn\" (UniqueName: \"kubernetes.io/projected/3651606a-0242-4cae-b812-db0eb3ffc142-kube-api-access-ddngn\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:36:03.724045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.724016    2572 generic.go:356] "Generic (PLEG): container finished" podID="3651606a-0242-4cae-b812-db0eb3ffc142" containerID="3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9" exitCode=137
Sep 11 21:36:03.724228 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.724060    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7807-776677"
Sep 11 21:36:03.724228 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.724121    2572 scope.go:117] "RemoveContainer" containerID="3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9"
Sep 11 21:36:03.733845 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.733825    2572 scope.go:117] "RemoveContainer" containerID="3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9"
Sep 11 21:36:03.734106 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:03.734086    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9\": container with ID starting with 3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9 not found: ID does not exist" containerID="3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9"
Sep 11 21:36:03.734155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.734114    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9"} err="failed to get container status \"3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9\": rpc error: code = NotFound desc = could not find container \"3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9\": container with ID starting with 3ff30c63ee09e71ca2a45e214a3bffd37978d1ed2a5838973dc9cbadad9f4de9 not found: ID does not exist"
Sep 11 21:36:03.734415 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:03.734399    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7807-776677\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="3651606a-0242-4cae-b812-db0eb3ffc142" pod="opendatahub/test-curl-7807-776677"
Sep 11 21:36:03.843864 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.843772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:03.941934 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:03.941894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:04.041631 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:04.041594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:04.144679 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:04.144647    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3651606a-0242-4cae-b812-db0eb3ffc142" path="/var/lib/kubelet/pods/3651606a-0242-4cae-b812-db0eb3ffc142/volumes"
Sep 11 21:36:04.979306 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:04.979271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:05.823598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:05.823557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:06.558720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:06.558684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:06.655667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:06.655623    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.176945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.176912    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"]
Sep 11 21:36:07.177149 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.177124    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" podUID="0d4c68bf-076c-4ebc-85d8-af001dec84d5" containerName="maas-api" containerID="cri-o://e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441" gracePeriod=30
Sep 11 21:36:07.207383 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.207348    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.283748 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.283710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.405368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.405333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.444237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.444165    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:36:07.556452 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.556421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.566124 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.566100    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzvrl\" (UniqueName: \"kubernetes.io/projected/0d4c68bf-076c-4ebc-85d8-af001dec84d5-kube-api-access-jzvrl\") pod \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") "
Sep 11 21:36:07.566569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.566166    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c68bf-076c-4ebc-85d8-af001dec84d5-openshift-service-ca\") pod \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") "
Sep 11 21:36:07.566569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.566205    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls\") pod \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") "
Sep 11 21:36:07.566569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.566278    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-metrics-certs\") pod \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\" (UID: \"0d4c68bf-076c-4ebc-85d8-af001dec84d5\") "
Sep 11 21:36:07.566569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.566533    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d4c68bf-076c-4ebc-85d8-af001dec84d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d4c68bf-076c-4ebc-85d8-af001dec84d5" (UID: "0d4c68bf-076c-4ebc-85d8-af001dec84d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:36:07.568463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.568430    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d4c68bf-076c-4ebc-85d8-af001dec84d5" (UID: "0d4c68bf-076c-4ebc-85d8-af001dec84d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:07.568463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.568440    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d4c68bf-076c-4ebc-85d8-af001dec84d5" (UID: "0d4c68bf-076c-4ebc-85d8-af001dec84d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:07.568606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.568481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4c68bf-076c-4ebc-85d8-af001dec84d5-kube-api-access-jzvrl" (OuterVolumeSpecName: "kube-api-access-jzvrl") pod "0d4c68bf-076c-4ebc-85d8-af001dec84d5" (UID: "0d4c68bf-076c-4ebc-85d8-af001dec84d5"). InnerVolumeSpecName "kube-api-access-jzvrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:07.592373 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.592340    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"]
Sep 11 21:36:07.592915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.592898    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3651606a-0242-4cae-b812-db0eb3ffc142" containerName="test-curl-7807-776677"
Sep 11 21:36:07.593018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.592918    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3651606a-0242-4cae-b812-db0eb3ffc142" containerName="test-curl-7807-776677"
Sep 11 21:36:07.593018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.592945    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4c68bf-076c-4ebc-85d8-af001dec84d5" containerName="maas-api"
Sep 11 21:36:07.593018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.592954    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4c68bf-076c-4ebc-85d8-af001dec84d5" containerName="maas-api"
Sep 11 21:36:07.593170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.593119    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4c68bf-076c-4ebc-85d8-af001dec84d5" containerName="maas-api"
Sep 11 21:36:07.593170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.593134    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3651606a-0242-4cae-b812-db0eb3ffc142" containerName="test-curl-7807-776677"
Sep 11 21:36:07.596534 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.596512    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.599286 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.599244    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bc0b206e-serving-cert\""
Sep 11 21:36:07.608606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.608580    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"]
Sep 11 21:36:07.640132 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.640093    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.667067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.667067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-metrics-certs\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.667358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgnjr\" (UniqueName: \"kubernetes.io/projected/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-kube-api-access-xgnjr\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.667358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-openshift-service-ca\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.667473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667376    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzvrl\" (UniqueName: \"kubernetes.io/projected/0d4c68bf-076c-4ebc-85d8-af001dec84d5-kube-api-access-jzvrl\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.667473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667397    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4c68bf-076c-4ebc-85d8-af001dec84d5-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.667473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667412    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.667473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.667427    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4c68bf-076c-4ebc-85d8-af001dec84d5-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.736557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.736463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.754697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.754661    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d4c68bf-076c-4ebc-85d8-af001dec84d5" containerID="e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441" exitCode=0
Sep 11 21:36:07.754886 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.754711    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"
Sep 11 21:36:07.754886 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.754751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" event={"ID":"0d4c68bf-076c-4ebc-85d8-af001dec84d5","Type":"ContainerDied","Data":"e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441"}
Sep 11 21:36:07.754886 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.754814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x" event={"ID":"0d4c68bf-076c-4ebc-85d8-af001dec84d5","Type":"ContainerDied","Data":"e13bb1c4ab6d70b92c2870f443671a510abe593fa8633f1b6ccaa9f155817da4"}
Sep 11 21:36:07.754886 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.754844    2572 scope.go:117] "RemoveContainer" containerID="e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441"
Sep 11 21:36:07.765991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.765972    2572 scope.go:117] "RemoveContainer" containerID="e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441"
Sep 11 21:36:07.766325 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:07.766304    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441\": container with ID starting with e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441 not found: ID does not exist" containerID="e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441"
Sep 11 21:36:07.766399 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.766334    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441"} err="failed to get container status \"e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441\": rpc error: code = NotFound desc = could not find container \"e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441\": container with ID starting with e238e979cdfee0dd6e2090826df9528fbe488fef38cf1e2d4d71f45bb8fa0441 not found: ID does not exist"
Sep 11 21:36:07.767991 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.767966    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-openshift-service-ca\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.768126 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.768111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.768167 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.768138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-metrics-certs\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.768209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.768174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgnjr\" (UniqueName: \"kubernetes.io/projected/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-kube-api-access-xgnjr\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.768274 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:07.768239    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-serving-cert: secret "maas-api-e2e-mt-bc0b206e-serving-cert" not found
Sep 11 21:36:07.768338 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:36:07.768327    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls podName:5efbb86c-1e4f-432b-8731-fa4bf9bd646c nodeName:}" failed. No retries permitted until 2026-09-11 21:36:08.268308627 +0000 UTC m=+1130.580533974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls") pod "maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" (UID: "5efbb86c-1e4f-432b-8731-fa4bf9bd646c") : secret "maas-api-e2e-mt-bc0b206e-serving-cert" not found
Sep 11 21:36:07.768686 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.768667    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-openshift-service-ca\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.770642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.770623    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-metrics-certs\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.777897 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.777873    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"]
Sep 11 21:36:07.782068 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.782041    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgnjr\" (UniqueName: \"kubernetes.io/projected/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-kube-api-access-xgnjr\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:07.783586 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.783565    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02c60f-f7d9b6ccb-rr64x"]
Sep 11 21:36:07.911666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:07.911629    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:08.003031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.002993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:08.145079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.145046    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d4c68bf-076c-4ebc-85d8-af001dec84d5" path="/var/lib/kubelet/pods/0d4c68bf-076c-4ebc-85d8-af001dec84d5/volumes"
Sep 11 21:36:08.239026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.238992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:08.273463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.273365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:08.276121 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.276093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls\") pod \"maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:08.336871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.336837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:08.354849 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.354811    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"]
Sep 11 21:36:08.360176 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.360148    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.362976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.362954    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-bc0b206e\""
Sep 11 21:36:08.363112 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.363034    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-bc0b206e-dockercfg-9dj5b\""
Sep 11 21:36:08.372105 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.372075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"]
Sep 11 21:36:08.384960 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.384922    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"]
Sep 11 21:36:08.389312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.389286    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.396469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.396442    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"]
Sep 11 21:36:08.476517 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.476485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w74mq\" (UniqueName: \"kubernetes.io/projected/5aaf47dc-c24a-4356-82cb-ea85069cdb59-kube-api-access-w74mq\") pod \"payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") " pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.476681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.476571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab0a608-eda5-48fb-887f-4f640b24eecd-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.476681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.476649    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9sf\" (UniqueName: \"kubernetes.io/projected/0ab0a608-eda5-48fb-887f-4f640b24eecd-kube-api-access-7w9sf\") pod \"payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.476681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.476679    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaf47dc-c24a-4356-82cb-ea85069cdb59-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") " pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.509574 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.509536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:08.578017 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.577982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w74mq\" (UniqueName: \"kubernetes.io/projected/5aaf47dc-c24a-4356-82cb-ea85069cdb59-kube-api-access-w74mq\") pod \"payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") " pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.578475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.578038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab0a608-eda5-48fb-887f-4f640b24eecd-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.578475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.578115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9sf\" (UniqueName: \"kubernetes.io/projected/0ab0a608-eda5-48fb-887f-4f640b24eecd-kube-api-access-7w9sf\") pod \"payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.578475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.578146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaf47dc-c24a-4356-82cb-ea85069cdb59-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") " pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.578854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.578832    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab0a608-eda5-48fb-887f-4f640b24eecd-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.579010 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.578991    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaf47dc-c24a-4356-82cb-ea85069cdb59-plugins-config-volume\") pod \"payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") " pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.598548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.598518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w74mq\" (UniqueName: \"kubernetes.io/projected/5aaf47dc-c24a-4356-82cb-ea85069cdb59-kube-api-access-w74mq\") pod \"payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") " pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.600763 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.600739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9sf\" (UniqueName: \"kubernetes.io/projected/0ab0a608-eda5-48fb-887f-4f640b24eecd-kube-api-access-7w9sf\") pod \"payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.672334 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.672297    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:08.701484 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.701449    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:08.790763 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.790734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"]
Sep 11 21:36:08.792216 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:36:08.792182    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efbb86c_1e4f_432b_8731_fa4bf9bd646c.slice/crio-b822081be4e86e400cfa036752e45f5c663d27200a9bed3db9566f5994785995 WatchSource:0}: Error finding container b822081be4e86e400cfa036752e45f5c663d27200a9bed3db9566f5994785995: Status 404 returned error can't find the container with id b822081be4e86e400cfa036752e45f5c663d27200a9bed3db9566f5994785995
Sep 11 21:36:08.837582 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.837502    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:08.954997 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.954964    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"]
Sep 11 21:36:08.956157 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:36:08.956137    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab0a608_eda5_48fb_887f_4f640b24eecd.slice/crio-db14aee3b165e4f905514d7d0d7a0536587bd53728cb77dc88993f22e36f1123 WatchSource:0}: Error finding container db14aee3b165e4f905514d7d0d7a0536587bd53728cb77dc88993f22e36f1123: Status 404 returned error can't find the container with id db14aee3b165e4f905514d7d0d7a0536587bd53728cb77dc88993f22e36f1123
Sep 11 21:36:08.995601 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:08.995573    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"]
Sep 11 21:36:08.996185 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:36:08.996162    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaf47dc_c24a_4356_82cb_ea85069cdb59.slice/crio-a8751fdecc153978ff6956138cce5fade38ab6916650ae4d6eae02caa6bde209 WatchSource:0}: Error finding container a8751fdecc153978ff6956138cce5fade38ab6916650ae4d6eae02caa6bde209: Status 404 returned error can't find the container with id a8751fdecc153978ff6956138cce5fade38ab6916650ae4d6eae02caa6bde209
Sep 11 21:36:09.604064 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.604026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:09.774314 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.774271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224" event={"ID":"5aaf47dc-c24a-4356-82cb-ea85069cdb59","Type":"ContainerStarted","Data":"c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9"}
Sep 11 21:36:09.774492 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.774343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224" event={"ID":"5aaf47dc-c24a-4356-82cb-ea85069cdb59","Type":"ContainerStarted","Data":"a8751fdecc153978ff6956138cce5fade38ab6916650ae4d6eae02caa6bde209"}
Sep 11 21:36:09.774492 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.774449    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:09.775995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.775973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck" event={"ID":"0ab0a608-eda5-48fb-887f-4f640b24eecd","Type":"ContainerStarted","Data":"964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39"}
Sep 11 21:36:09.776117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.776014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck" event={"ID":"0ab0a608-eda5-48fb-887f-4f640b24eecd","Type":"ContainerStarted","Data":"db14aee3b165e4f905514d7d0d7a0536587bd53728cb77dc88993f22e36f1123"}
Sep 11 21:36:09.776117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.776044    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:09.777571 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.777545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" event={"ID":"5efbb86c-1e4f-432b-8731-fa4bf9bd646c","Type":"ContainerStarted","Data":"282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262"}
Sep 11 21:36:09.777667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.777593    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" event={"ID":"5efbb86c-1e4f-432b-8731-fa4bf9bd646c","Type":"ContainerStarted","Data":"b822081be4e86e400cfa036752e45f5c663d27200a9bed3db9566f5994785995"}
Sep 11 21:36:09.777667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.777623    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:09.792176 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.792136    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224" podStartSLOduration=1.792122248 podStartE2EDuration="1.792122248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:09.790816948 +0000 UTC m=+1132.103042309" watchObservedRunningTime="2026-09-11 21:36:09.792122248 +0000 UTC m=+1132.104347613"
Sep 11 21:36:09.811150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.811101    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" podStartSLOduration=2.398140919 podStartE2EDuration="2.811086879s" totalImagesPullingTime="412.94596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:09.808971574 +0000 UTC m=+1132.121196939" watchObservedRunningTime="2026-09-11 21:36:09.811086879 +0000 UTC m=+1132.123312295"
Sep 11 21:36:09.827564 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:09.827503    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck" podStartSLOduration=1.827480311 podStartE2EDuration="1.827480311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:09.824297614 +0000 UTC m=+1132.136522981" watchObservedRunningTime="2026-09-11 21:36:09.827480311 +0000 UTC m=+1132.139705683"
Sep 11 21:36:10.591995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:10.591953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:11.290816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:11.290774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:12.133024 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:12.132992    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:12.923778 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:12.923736    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:13.968381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:13.968341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:14.068798 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:14.068761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:14.236204 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:14.236114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:14.793955 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:14.793918    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:15.116681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:15.116600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:15.205372 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:15.205328    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:15.788761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:15.788729    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:36:18.000111 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:18.000073    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:18.661316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:18.661219    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:18.759398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:18.759363    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:18.856335 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:18.856297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:19.606913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:19.606881    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:20.483943 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:20.483909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:20.786343 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:20.786306    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:36:20.786789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:20.786378    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:36:21.565762 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:21.565722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:22.341233 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:22.341192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:23.190316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:23.190279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:23.632711 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:23.632676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:23.960058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:23.959965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:24.061946 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.061912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:24.495860 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.495830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:24.593674 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.593635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:24.621410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.621376    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"]
Sep 11 21:36:24.626618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.626601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.629209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.629189    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-c97420\""
Sep 11 21:36:24.638306 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.638284    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"]
Sep 11 21:36:24.742421 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.742381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psxnl\" (UniqueName: \"kubernetes.io/projected/8f2a155f-3c2c-4798-8735-e1fea010955c-kube-api-access-psxnl\") pod \"payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.742625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.742523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2a155f-3c2c-4798-8735-e1fea010955c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.788859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.788825    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:24.843975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.843936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psxnl\" (UniqueName: \"kubernetes.io/projected/8f2a155f-3c2c-4798-8735-e1fea010955c-kube-api-access-psxnl\") pod \"payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.844165 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.843995    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2a155f-3c2c-4798-8735-e1fea010955c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.844721 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.844700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2a155f-3c2c-4798-8735-e1fea010955c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.852950 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.852922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psxnl\" (UniqueName: \"kubernetes.io/projected/8f2a155f-3c2c-4798-8735-e1fea010955c-kube-api-access-psxnl\") pod \"payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:24.939585 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:24.939554    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:25.037378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.037341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:25.221790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.221760    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"]
Sep 11 21:36:25.222302 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:36:25.222279    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2a155f_3c2c_4798_8735_e1fea010955c.slice/crio-379a2816b95753a0d3c5ffdb36c7972620814c94ce2801aee52ac9b84da3388d WatchSource:0}: Error finding container 379a2816b95753a0d3c5ffdb36c7972620814c94ce2801aee52ac9b84da3388d: Status 404 returned error can't find the container with id 379a2816b95753a0d3c5ffdb36c7972620814c94ce2801aee52ac9b84da3388d
Sep 11 21:36:25.881160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.881128    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85" event={"ID":"8f2a155f-3c2c-4798-8735-e1fea010955c","Type":"ContainerStarted","Data":"c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91"}
Sep 11 21:36:25.881610 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.881186    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85" event={"ID":"8f2a155f-3c2c-4798-8735-e1fea010955c","Type":"ContainerStarted","Data":"379a2816b95753a0d3c5ffdb36c7972620814c94ce2801aee52ac9b84da3388d"}
Sep 11 21:36:25.881610 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.881225    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:25.900170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.900116    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85" podStartSLOduration=1.900096298 podStartE2EDuration="1.900096298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:25.898519153 +0000 UTC m=+1148.210744520" watchObservedRunningTime="2026-09-11 21:36:25.900096298 +0000 UTC m=+1148.212321663"
Sep 11 21:36:25.914819 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:25.914787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:26.857722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:26.857684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:27.660566 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:27.660531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:28.407778 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:28.407741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:29.113600 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:29.113564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:29.789274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:29.789214    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:30.610542 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:30.610507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:33.876013 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:33.875974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:36.389011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:36.388974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:36.889673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:36.889639    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:36:40.451058 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:40.450973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:45.066973 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:45.066915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:46.294010 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:46.293977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:47.108964 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:47.108924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:47.909199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:47.909165    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:48.595516 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:48.595478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:48.787978 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:48.787944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:49.130618 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:49.130588    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:49.393078 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:49.392994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:49.500199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:49.500155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:49.701067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:49.700971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:50.190137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:50.190096    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:51.067905 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:51.067866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:52.398667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:52.398632    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:53.002109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:53.002069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:53.092575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:53.092539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:53.395540 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:53.395449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:54.305693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:54.305658    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:55.008391 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:55.008356    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:55.910189 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:55.910069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:56.622797 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:56.622750    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:57.343297 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:57.343264    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:58.198003 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.197968    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:58.265966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.265928    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:58.456407 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.456285    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:58.670992 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.670958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:58.769267 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.769228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:58.784274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.784219    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"]
Sep 11 21:36:58.787743 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.787723    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:58.790309 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.790291    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e0c211\""
Sep 11 21:36:58.790423 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.790290    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e0c211-dockercfg-dq2tt\""
Sep 11 21:36:58.799437 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.799411    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"]
Sep 11 21:36:58.812655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.812621    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"]
Sep 11 21:36:58.816551 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.816525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:58.827274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.827226    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"]
Sep 11 21:36:58.900234 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.900201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f62f00f-1a50-477b-bf7a-83bc167f8f20-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:58.900419 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.900260    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfl5z\" (UniqueName: \"kubernetes.io/projected/7f62f00f-1a50-477b-bf7a-83bc167f8f20-kube-api-access-pfl5z\") pod \"payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:58.900419 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.900288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/890d12a6-14a9-4a9c-975c-b769fce05fc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:58.900419 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:58.900331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ghqp\" (UniqueName: \"kubernetes.io/projected/890d12a6-14a9-4a9c-975c-b769fce05fc1-kube-api-access-4ghqp\") pod \"payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:59.001626 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.001582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f62f00f-1a50-477b-bf7a-83bc167f8f20-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:59.001823 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.001649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfl5z\" (UniqueName: \"kubernetes.io/projected/7f62f00f-1a50-477b-bf7a-83bc167f8f20-kube-api-access-pfl5z\") pod \"payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:59.001823 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.001691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/890d12a6-14a9-4a9c-975c-b769fce05fc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:59.001823 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.001737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ghqp\" (UniqueName: \"kubernetes.io/projected/890d12a6-14a9-4a9c-975c-b769fce05fc1-kube-api-access-4ghqp\") pod \"payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:59.002477 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.002451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f62f00f-1a50-477b-bf7a-83bc167f8f20-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:59.002584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.002493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/890d12a6-14a9-4a9c-975c-b769fce05fc1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:59.011133 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.011105    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfl5z\" (UniqueName: \"kubernetes.io/projected/7f62f00f-1a50-477b-bf7a-83bc167f8f20-kube-api-access-pfl5z\") pod \"payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:59.011245 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.011136    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ghqp\" (UniqueName: \"kubernetes.io/projected/890d12a6-14a9-4a9c-975c-b769fce05fc1-kube-api-access-4ghqp\") pod \"payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:59.099274 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.099160    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:36:59.128349 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.128318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:36:59.380514 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.380487    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"]
Sep 11 21:36:59.381897 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:36:59.381870    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890d12a6_14a9_4a9c_975c_b769fce05fc1.slice/crio-ba3fa6ba6a210304644431f77f45ddf94490079e70d48d7525c7d0e8831cbbb3 WatchSource:0}: Error finding container ba3fa6ba6a210304644431f77f45ddf94490079e70d48d7525c7d0e8831cbbb3: Status 404 returned error can't find the container with id ba3fa6ba6a210304644431f77f45ddf94490079e70d48d7525c7d0e8831cbbb3
Sep 11 21:36:59.415317 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:36:59.415289    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"]
Sep 11 21:36:59.420482 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:36:59.420452    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f62f00f_1a50_477b_bf7a_83bc167f8f20.slice/crio-9c7ee33ba16766eba78a3e3cd9a07722342d1eb5aba82b40883a2e35155a0f7e WatchSource:0}: Error finding container 9c7ee33ba16766eba78a3e3cd9a07722342d1eb5aba82b40883a2e35155a0f7e: Status 404 returned error can't find the container with id 9c7ee33ba16766eba78a3e3cd9a07722342d1eb5aba82b40883a2e35155a0f7e
Sep 11 21:37:00.095677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.095634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw" event={"ID":"7f62f00f-1a50-477b-bf7a-83bc167f8f20","Type":"ContainerStarted","Data":"8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33"}
Sep 11 21:37:00.096120 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.095707    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:37:00.096120 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.095733    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw" event={"ID":"7f62f00f-1a50-477b-bf7a-83bc167f8f20","Type":"ContainerStarted","Data":"9c7ee33ba16766eba78a3e3cd9a07722342d1eb5aba82b40883a2e35155a0f7e"}
Sep 11 21:37:00.097304 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.097276    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl" event={"ID":"890d12a6-14a9-4a9c-975c-b769fce05fc1","Type":"ContainerStarted","Data":"3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1"}
Sep 11 21:37:00.097439 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.097330    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:37:00.097439 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.097353    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl" event={"ID":"890d12a6-14a9-4a9c-975c-b769fce05fc1","Type":"ContainerStarted","Data":"ba3fa6ba6a210304644431f77f45ddf94490079e70d48d7525c7d0e8831cbbb3"}
Sep 11 21:37:00.114478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.114427    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw" podStartSLOduration=2.114409977 podStartE2EDuration="2.114409977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:37:00.111791681 +0000 UTC m=+1182.424017054" watchObservedRunningTime="2026-09-11 21:37:00.114409977 +0000 UTC m=+1182.426635344"
Sep 11 21:37:00.129366 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:00.129316    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl" podStartSLOduration=2.129301582 podStartE2EDuration="2.129301582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:37:00.127165547 +0000 UTC m=+1182.439390915" watchObservedRunningTime="2026-09-11 21:37:00.129301582 +0000 UTC m=+1182.441526947"
Sep 11 21:37:11.104640 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:11.104607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:37:11.105131 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:11.104681    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:37:18.212798 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:18.212761    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:37:18.216805 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:18.216777    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:37:20.110706 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:20.110661    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:20.961920 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:20.961884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:21.667218 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:21.667180    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:22.711395 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:22.711363    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:23.149690 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:23.149642    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:23.620292 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:23.620239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:24.149011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:24.148973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:24.693629 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:24.693586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:25.514885 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:25.514843    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:26.210623 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:26.210585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:32.969508 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:32.969463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:34.901232 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.901196    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"]
Sep 11 21:37:34.906417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.906392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:34.910314 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.910293    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-c97420\"/\"auth-test-model-c97420-kserve-self-signed-certs\""
Sep 11 21:37:34.910431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.910313    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-c97420\"/\"default-dockercfg-88njg\""
Sep 11 21:37:34.910431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.910327    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-c97420\"/\"openshift-service-ca.crt\""
Sep 11 21:37:34.910431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.910298    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-c97420\"/\"kube-root-ca.crt\""
Sep 11 21:37:34.920291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.920246    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"]
Sep 11 21:37:34.939667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.939625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:37:34.966161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.966127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-dshm\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:34.966161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.966160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-model-cache\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:34.966375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.966203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-tmp-dir\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:34.966375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.966239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl2kl\" (UniqueName: \"kubernetes.io/projected/cac3b235-da02-4eb7-8105-40ec1cae88f6-kube-api-access-pl2kl\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:34.966375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.966313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cac3b235-da02-4eb7-8105-40ec1cae88f6-tls-certs\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:34.966375 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:34.966370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-home\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067411 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-dshm\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067411 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-model-cache\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-tmp-dir\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl2kl\" (UniqueName: \"kubernetes.io/projected/cac3b235-da02-4eb7-8105-40ec1cae88f6-kube-api-access-pl2kl\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067580    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cac3b235-da02-4eb7-8105-40ec1cae88f6-tls-certs\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-home\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.067910 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067853    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-model-cache\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.068247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.067966    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-home\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.068247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.068208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-tmp-dir\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.070719 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.070694    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-dshm\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.070966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.070944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cac3b235-da02-4eb7-8105-40ec1cae88f6-tls-certs\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.080839 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.080821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl2kl\" (UniqueName: \"kubernetes.io/projected/cac3b235-da02-4eb7-8105-40ec1cae88f6-kube-api-access-pl2kl\") pod \"auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") " pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.215772 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.215681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:35.494901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:35.494869    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"]
Sep 11 21:37:35.495742 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:37:35.495710    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcac3b235_da02_4eb7_8105_40ec1cae88f6.slice/crio-632199e567a6a401edff0a75c6f231e1ce6580b2cef8e037acba89983ce25340 WatchSource:0}: Error finding container 632199e567a6a401edff0a75c6f231e1ce6580b2cef8e037acba89983ce25340: Status 404 returned error can't find the container with id 632199e567a6a401edff0a75c6f231e1ce6580b2cef8e037acba89983ce25340
Sep 11 21:37:36.335475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:36.335427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk" event={"ID":"cac3b235-da02-4eb7-8105-40ec1cae88f6","Type":"ContainerStarted","Data":"1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb"}
Sep 11 21:37:36.335907 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:36.335487    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk" event={"ID":"cac3b235-da02-4eb7-8105-40ec1cae88f6","Type":"ContainerStarted","Data":"632199e567a6a401edff0a75c6f231e1ce6580b2cef8e037acba89983ce25340"}
Sep 11 21:37:36.356954 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:36.356902    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk" podStartSLOduration=2.356887585 podStartE2EDuration="2.356887585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:37:36.356231561 +0000 UTC m=+1218.668456928" watchObservedRunningTime="2026-09-11 21:37:36.356887585 +0000 UTC m=+1218.669112950"
Sep 11 21:37:45.216436 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:45.216394    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:45.218979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:45.216680    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:45.229642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:45.229619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:45.402463 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:45.402429    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:37:50.695352 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:50.695321    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"]
Sep 11 21:37:50.716596 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:37:50.716559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:05.715705 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:05.715635    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z" podUID="2bcb80f9-9b3b-4957-ae0d-186bb452574b" containerName="main" containerID="cri-o://cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca" gracePeriod=45
Sep 11 21:38:05.971378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:05.971321    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:38:06.073076 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073043    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-home\") pod \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") "
Sep 11 21:38:06.073296 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073100    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-dshm\") pod \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") "
Sep 11 21:38:06.073296 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073132    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-model-cache\") pod \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") "
Sep 11 21:38:06.073296 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073187    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tmp-dir\") pod \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") "
Sep 11 21:38:06.073296 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073208    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tls-certs\") pod \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") "
Sep 11 21:38:06.073548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073310    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5652k\" (UniqueName: \"kubernetes.io/projected/2bcb80f9-9b3b-4957-ae0d-186bb452574b-kube-api-access-5652k\") pod \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\" (UID: \"2bcb80f9-9b3b-4957-ae0d-186bb452574b\") "
Sep 11 21:38:06.073548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073368    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-home" (OuterVolumeSpecName: "home") pod "2bcb80f9-9b3b-4957-ae0d-186bb452574b" (UID: "2bcb80f9-9b3b-4957-ae0d-186bb452574b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:06.073548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073482    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2bcb80f9-9b3b-4957-ae0d-186bb452574b" (UID: "2bcb80f9-9b3b-4957-ae0d-186bb452574b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:06.073548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073499    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2bcb80f9-9b3b-4957-ae0d-186bb452574b" (UID: "2bcb80f9-9b3b-4957-ae0d-186bb452574b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:06.073742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073624    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-home\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:06.073742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073642    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-model-cache\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:06.073742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.073658    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tmp-dir\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:06.075539 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.075510    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-dshm" (OuterVolumeSpecName: "dshm") pod "2bcb80f9-9b3b-4957-ae0d-186bb452574b" (UID: "2bcb80f9-9b3b-4957-ae0d-186bb452574b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:06.075640 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.075549    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2bcb80f9-9b3b-4957-ae0d-186bb452574b" (UID: "2bcb80f9-9b3b-4957-ae0d-186bb452574b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:38:06.075640 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.075568    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcb80f9-9b3b-4957-ae0d-186bb452574b-kube-api-access-5652k" (OuterVolumeSpecName: "kube-api-access-5652k") pod "2bcb80f9-9b3b-4957-ae0d-186bb452574b" (UID: "2bcb80f9-9b3b-4957-ae0d-186bb452574b"). InnerVolumeSpecName "kube-api-access-5652k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:06.175079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.175047    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bcb80f9-9b3b-4957-ae0d-186bb452574b-tls-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:06.175079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.175076    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5652k\" (UniqueName: \"kubernetes.io/projected/2bcb80f9-9b3b-4957-ae0d-186bb452574b-kube-api-access-5652k\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:06.175079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.175086    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bcb80f9-9b3b-4957-ae0d-186bb452574b-dshm\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:06.524050 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.524014    2572 generic.go:356] "Generic (PLEG): container finished" podID="2bcb80f9-9b3b-4957-ae0d-186bb452574b" containerID="cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca" exitCode=0
Sep 11 21:38:06.524232 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.524056    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"
Sep 11 21:38:06.524232 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.524055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z" event={"ID":"2bcb80f9-9b3b-4957-ae0d-186bb452574b","Type":"ContainerDied","Data":"cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca"}
Sep 11 21:38:06.524232 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.524105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z" event={"ID":"2bcb80f9-9b3b-4957-ae0d-186bb452574b","Type":"ContainerDied","Data":"8ef69ae773f3a1acebf88fdc1e10df7be5b217e06b60f3ffe95d8bb9f3a2634d"}
Sep 11 21:38:06.524232 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.524129    2572 scope.go:117] "RemoveContainer" containerID="cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca"
Sep 11 21:38:06.533810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.533794    2572 scope.go:117] "RemoveContainer" containerID="cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca"
Sep 11 21:38:06.534078 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:38:06.534059    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca\": container with ID starting with cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca not found: ID does not exist" containerID="cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca"
Sep 11 21:38:06.534153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.534088    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca"} err="failed to get container status \"cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca\": rpc error: code = NotFound desc = could not find container \"cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca\": container with ID starting with cbd33e40ac9d200a8b3ff858952773cfdec4bda5faf11f7586825236f38561ca not found: ID does not exist"
Sep 11 21:38:06.541502 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.541476    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"]
Sep 11 21:38:06.544863 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:06.544838    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-83ba87/e2e-conflict-a-315f74cf-kserve-988f6d6f8-m4n7z"]
Sep 11 21:38:08.144923 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:08.144889    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bcb80f9-9b3b-4957-ae0d-186bb452574b" path="/var/lib/kubelet/pods/2bcb80f9-9b3b-4957-ae0d-186bb452574b/volumes"
Sep 11 21:38:09.157723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:09.157690    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:15.873950 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:15.873912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:15.974530 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:15.974477    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:16.075542 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:16.075504    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:16.779591 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:16.779545    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:17.504707 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:17.504673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:18.302340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:18.302245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:19.103326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:19.103290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:19.797487 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:19.797450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:20.628721 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:20.628687    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:20.796476 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:20.796446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:21.395386 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:21.395342    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:22.207941 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:22.207896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:31.290807 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.290768    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"]
Sep 11 21:38:31.291292 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.291098    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" podUID="5efbb86c-1e4f-432b-8731-fa4bf9bd646c" containerName="maas-api" containerID="cri-o://282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262" gracePeriod=30
Sep 11 21:38:31.308555 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.308481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:31.355128 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.355096    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"]
Sep 11 21:38:31.355371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.355326    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224" podUID="5aaf47dc-c24a-4356-82cb-ea85069cdb59" containerName="payload-processing" containerID="cri-o://c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9" gracePeriod=30
Sep 11 21:38:31.369581 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.369553    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"]
Sep 11 21:38:31.369767 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.369746    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck" podUID="0ab0a608-eda5-48fb-887f-4f640b24eecd" containerName="payload-pre-processing" containerID="cri-o://964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39" gracePeriod=30
Sep 11 21:38:31.441837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.441810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:31.544199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.543907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:31.674316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.674280    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:38:31.677748 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.677721    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:38:31.681553 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.681531    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:38:31.690653 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.690628    2572 generic.go:356] "Generic (PLEG): container finished" podID="5efbb86c-1e4f-432b-8731-fa4bf9bd646c" containerID="282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262" exitCode=0
Sep 11 21:38:31.690795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.690660    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" event={"ID":"5efbb86c-1e4f-432b-8731-fa4bf9bd646c","Type":"ContainerDied","Data":"282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262"}
Sep 11 21:38:31.690795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.690711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm" event={"ID":"5efbb86c-1e4f-432b-8731-fa4bf9bd646c","Type":"ContainerDied","Data":"b822081be4e86e400cfa036752e45f5c663d27200a9bed3db9566f5994785995"}
Sep 11 21:38:31.690795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.690737    2572 scope.go:117] "RemoveContainer" containerID="282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262"
Sep 11 21:38:31.690795 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.690671    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"
Sep 11 21:38:31.692281 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.692239    2572 generic.go:356] "Generic (PLEG): container finished" podID="5aaf47dc-c24a-4356-82cb-ea85069cdb59" containerID="c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9" exitCode=0
Sep 11 21:38:31.692404 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.692298    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"
Sep 11 21:38:31.692404 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.692319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224" event={"ID":"5aaf47dc-c24a-4356-82cb-ea85069cdb59","Type":"ContainerDied","Data":"c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9"}
Sep 11 21:38:31.692404 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.692364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224" event={"ID":"5aaf47dc-c24a-4356-82cb-ea85069cdb59","Type":"ContainerDied","Data":"a8751fdecc153978ff6956138cce5fade38ab6916650ae4d6eae02caa6bde209"}
Sep 11 21:38:31.693695 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.693676    2572 generic.go:356] "Generic (PLEG): container finished" podID="0ab0a608-eda5-48fb-887f-4f640b24eecd" containerID="964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39" exitCode=0
Sep 11 21:38:31.693789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.693713    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"
Sep 11 21:38:31.693789 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.693760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck" event={"ID":"0ab0a608-eda5-48fb-887f-4f640b24eecd","Type":"ContainerDied","Data":"964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39"}
Sep 11 21:38:31.693877 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.693800    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck" event={"ID":"0ab0a608-eda5-48fb-887f-4f640b24eecd","Type":"ContainerDied","Data":"db14aee3b165e4f905514d7d0d7a0536587bd53728cb77dc88993f22e36f1123"}
Sep 11 21:38:31.700381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.700359    2572 scope.go:117] "RemoveContainer" containerID="282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262"
Sep 11 21:38:31.700635 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:38:31.700618    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262\": container with ID starting with 282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262 not found: ID does not exist" containerID="282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262"
Sep 11 21:38:31.700691 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.700644    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262"} err="failed to get container status \"282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262\": rpc error: code = NotFound desc = could not find container \"282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262\": container with ID starting with 282dabdcbd0335ddfaec2eeec0151c86c7bbfccfba82dbd189b73a09736a4262 not found: ID does not exist"
Sep 11 21:38:31.700691 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.700660    2572 scope.go:117] "RemoveContainer" containerID="c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9"
Sep 11 21:38:31.709622 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.709605    2572 scope.go:117] "RemoveContainer" containerID="c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9"
Sep 11 21:38:31.709881 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:38:31.709859    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9\": container with ID starting with c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9 not found: ID does not exist" containerID="c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9"
Sep 11 21:38:31.709952 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.709887    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9"} err="failed to get container status \"c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9\": rpc error: code = NotFound desc = could not find container \"c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9\": container with ID starting with c1d95317372896edd89c3943e497269588c4339fd705bce011c7ba17687a5fa9 not found: ID does not exist"
Sep 11 21:38:31.709952 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.709903    2572 scope.go:117] "RemoveContainer" containerID="964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39"
Sep 11 21:38:31.715485 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.715439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:31.719437 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.719415    2572 scope.go:117] "RemoveContainer" containerID="964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39"
Sep 11 21:38:31.719801 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:38:31.719777    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39\": container with ID starting with 964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39 not found: ID does not exist" containerID="964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39"
Sep 11 21:38:31.719883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.719806    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39"} err="failed to get container status \"964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39\": rpc error: code = NotFound desc = could not find container \"964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39\": container with ID starting with 964d906f9bfb371b21a283c7d39909eaf6e228aead4427cf42c79b8143ca1d39 not found: ID does not exist"
Sep 11 21:38:31.732223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732190    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab0a608-eda5-48fb-887f-4f640b24eecd-plugins-config-volume\") pod \"0ab0a608-eda5-48fb-887f-4f640b24eecd\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") "
Sep 11 21:38:31.732429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732305    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgnjr\" (UniqueName: \"kubernetes.io/projected/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-kube-api-access-xgnjr\") pod \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") "
Sep 11 21:38:31.732429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732333    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaf47dc-c24a-4356-82cb-ea85069cdb59-plugins-config-volume\") pod \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") "
Sep 11 21:38:31.732429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w9sf\" (UniqueName: \"kubernetes.io/projected/0ab0a608-eda5-48fb-887f-4f640b24eecd-kube-api-access-7w9sf\") pod \"0ab0a608-eda5-48fb-887f-4f640b24eecd\" (UID: \"0ab0a608-eda5-48fb-887f-4f640b24eecd\") "
Sep 11 21:38:31.732429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732424    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls\") pod \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") "
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732667    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab0a608-eda5-48fb-887f-4f640b24eecd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ab0a608-eda5-48fb-887f-4f640b24eecd" (UID: "0ab0a608-eda5-48fb-887f-4f640b24eecd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732740    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-metrics-certs\") pod \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") "
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732746    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aaf47dc-c24a-4356-82cb-ea85069cdb59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5aaf47dc-c24a-4356-82cb-ea85069cdb59" (UID: "5aaf47dc-c24a-4356-82cb-ea85069cdb59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732858    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w74mq\" (UniqueName: \"kubernetes.io/projected/5aaf47dc-c24a-4356-82cb-ea85069cdb59-kube-api-access-w74mq\") pod \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\" (UID: \"5aaf47dc-c24a-4356-82cb-ea85069cdb59\") "
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.732891    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-openshift-service-ca\") pod \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\" (UID: \"5efbb86c-1e4f-432b-8731-fa4bf9bd646c\") "
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.733317    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ab0a608-eda5-48fb-887f-4f640b24eecd-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.733370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.733341    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aaf47dc-c24a-4356-82cb-ea85069cdb59-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.733835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.733496    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5efbb86c-1e4f-432b-8731-fa4bf9bd646c" (UID: "5efbb86c-1e4f-432b-8731-fa4bf9bd646c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:38:31.735229 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.735182    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5efbb86c-1e4f-432b-8731-fa4bf9bd646c" (UID: "5efbb86c-1e4f-432b-8731-fa4bf9bd646c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:38:31.735462 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.735282    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5efbb86c-1e4f-432b-8731-fa4bf9bd646c" (UID: "5efbb86c-1e4f-432b-8731-fa4bf9bd646c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:38:31.735462 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.735388    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab0a608-eda5-48fb-887f-4f640b24eecd-kube-api-access-7w9sf" (OuterVolumeSpecName: "kube-api-access-7w9sf") pod "0ab0a608-eda5-48fb-887f-4f640b24eecd" (UID: "0ab0a608-eda5-48fb-887f-4f640b24eecd"). InnerVolumeSpecName "kube-api-access-7w9sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:31.735635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.735619    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-kube-api-access-xgnjr" (OuterVolumeSpecName: "kube-api-access-xgnjr") pod "5efbb86c-1e4f-432b-8731-fa4bf9bd646c" (UID: "5efbb86c-1e4f-432b-8731-fa4bf9bd646c"). InnerVolumeSpecName "kube-api-access-xgnjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:31.736514 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.736483    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aaf47dc-c24a-4356-82cb-ea85069cdb59-kube-api-access-w74mq" (OuterVolumeSpecName: "kube-api-access-w74mq") pod "5aaf47dc-c24a-4356-82cb-ea85069cdb59" (UID: "5aaf47dc-c24a-4356-82cb-ea85069cdb59"). InnerVolumeSpecName "kube-api-access-w74mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:31.834560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.834480    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgnjr\" (UniqueName: \"kubernetes.io/projected/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-kube-api-access-xgnjr\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.834560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.834508    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w9sf\" (UniqueName: \"kubernetes.io/projected/0ab0a608-eda5-48fb-887f-4f640b24eecd-kube-api-access-7w9sf\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.834560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.834521    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.834560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.834533    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.834560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.834545    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w74mq\" (UniqueName: \"kubernetes.io/projected/5aaf47dc-c24a-4356-82cb-ea85069cdb59-kube-api-access-w74mq\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.834560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.834558    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efbb86c-1e4f-432b-8731-fa4bf9bd646c-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:38:31.883745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:31.883708    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:32.030947 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.030907    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"]
Sep 11 21:38:32.045761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.045730    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc0b206e-9d8b97c96-cbjhm"]
Sep 11 21:38:32.070537 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.070501    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"]
Sep 11 21:38:32.082240 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.082209    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bc0b206e-7f5ccb7f46-w55ck"]
Sep 11 21:38:32.106651 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.106579    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"]
Sep 11 21:38:32.109784 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.109758    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-bc0b206e-b8dd54f7-77224"]
Sep 11 21:38:32.144943 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.144913    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab0a608-eda5-48fb-887f-4f640b24eecd" path="/var/lib/kubelet/pods/0ab0a608-eda5-48fb-887f-4f640b24eecd/volumes"
Sep 11 21:38:32.145350 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.145335    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aaf47dc-c24a-4356-82cb-ea85069cdb59" path="/var/lib/kubelet/pods/5aaf47dc-c24a-4356-82cb-ea85069cdb59/volumes"
Sep 11 21:38:32.145727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.145715    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5efbb86c-1e4f-432b-8731-fa4bf9bd646c" path="/var/lib/kubelet/pods/5efbb86c-1e4f-432b-8731-fa4bf9bd646c/volumes"
Sep 11 21:38:32.297360 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:32.297325    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:33.169733 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:33.169700    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:34.057589 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:34.057543    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:34.816620 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:34.816586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:34.990694 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:34.990662    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:35.641669 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:35.641635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:36.410321 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:36.410278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:37.219237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:37.219205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:40.022427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:40.022384    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:44.099993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:44.099958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:45.890324 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890287    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"]
Sep 11 21:38:45.890854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890834    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aaf47dc-c24a-4356-82cb-ea85069cdb59" containerName="payload-processing"
Sep 11 21:38:45.890900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890857    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aaf47dc-c24a-4356-82cb-ea85069cdb59" containerName="payload-processing"
Sep 11 21:38:45.890900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890872    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcb80f9-9b3b-4957-ae0d-186bb452574b" containerName="main"
Sep 11 21:38:45.890900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890877    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcb80f9-9b3b-4957-ae0d-186bb452574b" containerName="main"
Sep 11 21:38:45.890900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890894    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab0a608-eda5-48fb-887f-4f640b24eecd" containerName="payload-pre-processing"
Sep 11 21:38:45.890900 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890901    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab0a608-eda5-48fb-887f-4f640b24eecd" containerName="payload-pre-processing"
Sep 11 21:38:45.891046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890915    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efbb86c-1e4f-432b-8731-fa4bf9bd646c" containerName="maas-api"
Sep 11 21:38:45.891046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.890920    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efbb86c-1e4f-432b-8731-fa4bf9bd646c" containerName="maas-api"
Sep 11 21:38:45.891046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.891001    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcb80f9-9b3b-4957-ae0d-186bb452574b" containerName="main"
Sep 11 21:38:45.891046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.891009    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aaf47dc-c24a-4356-82cb-ea85069cdb59" containerName="payload-processing"
Sep 11 21:38:45.891046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.891016    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efbb86c-1e4f-432b-8731-fa4bf9bd646c" containerName="maas-api"
Sep 11 21:38:45.891046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.891023    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab0a608-eda5-48fb-887f-4f640b24eecd" containerName="payload-pre-processing"
Sep 11 21:38:45.896129 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.896111    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:45.899657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.899630    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e0c211\"/\"kube-root-ca.crt\""
Sep 11 21:38:45.899777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.899637    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e0c211\"/\"openshift-service-ca.crt\""
Sep 11 21:38:45.899777 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.899668    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e0c211\"/\"default-dockercfg-mqtsg\""
Sep 11 21:38:45.900201 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.899903    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e0c211\"/\"auth-test-model-e0c211-kserve-self-signed-certs\""
Sep 11 21:38:45.906456 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.905386    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"]
Sep 11 21:38:45.913643 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.913614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:45.981382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.981339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-home\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:45.981547 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.981398    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-dshm\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:45.981547 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.981485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f50939c-ec5b-4b15-947d-afd1696a770d-tls-certs\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:45.981547 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.981523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-tmp-dir\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:45.981662 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.981552    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-model-cache\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:45.981662 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:45.981617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj9jb\" (UniqueName: \"kubernetes.io/projected/7f50939c-ec5b-4b15-947d-afd1696a770d-kube-api-access-pj9jb\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.082969 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.082925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-model-cache\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.082969 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.082989    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj9jb\" (UniqueName: \"kubernetes.io/projected/7f50939c-ec5b-4b15-947d-afd1696a770d-kube-api-access-pj9jb\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083031    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-home\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083063    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-dshm\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f50939c-ec5b-4b15-947d-afd1696a770d-tls-certs\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-tmp-dir\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083495 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083455    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-model-cache\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-home\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.083612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.083565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-tmp-dir\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.085438 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.085422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-dshm\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.085739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.085719    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f50939c-ec5b-4b15-947d-afd1696a770d-tls-certs\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.090726 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.090703    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj9jb\" (UniqueName: \"kubernetes.io/projected/7f50939c-ec5b-4b15-947d-afd1696a770d-kube-api-access-pj9jb\") pod \"auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") " pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.208394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.208295    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:46.481706 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.481677    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"]
Sep 11 21:38:46.483430 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:38:46.483403    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f50939c_ec5b_4b15_947d_afd1696a770d.slice/crio-93f928d48679eb40b881c84b7a7f2e7d4af61657ddd301e4e7e87ea2eab468ba WatchSource:0}: Error finding container 93f928d48679eb40b881c84b7a7f2e7d4af61657ddd301e4e7e87ea2eab468ba: Status 404 returned error can't find the container with id 93f928d48679eb40b881c84b7a7f2e7d4af61657ddd301e4e7e87ea2eab468ba
Sep 11 21:38:46.790324 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.790285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb" event={"ID":"7f50939c-ec5b-4b15-947d-afd1696a770d","Type":"ContainerStarted","Data":"ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef"}
Sep 11 21:38:46.790483 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.790334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb" event={"ID":"7f50939c-ec5b-4b15-947d-afd1696a770d","Type":"ContainerStarted","Data":"93f928d48679eb40b881c84b7a7f2e7d4af61657ddd301e4e7e87ea2eab468ba"}
Sep 11 21:38:46.811431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:46.811381    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb" podStartSLOduration=1.811365886 podStartE2EDuration="1.811365886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:46.80823935 +0000 UTC m=+1289.120464739" watchObservedRunningTime="2026-09-11 21:38:46.811365886 +0000 UTC m=+1289.123591289"
Sep 11 21:38:54.665492 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:54.665455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:54.735364 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:54.735329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:55.092098 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:55.092066    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:38:56.208956 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:56.208919    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:56.209417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:56.209001    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:56.221884 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:56.221857    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:38:56.864844 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:38:56.864817    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:39:16.113292 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:16.113245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:17.263409 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:17.263375    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:23.917682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:23.917641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:23.988009 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:23.987978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:24.203737 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:24.203644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:25.618213 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:25.618177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:25.726911 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:25.726872    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:26.387800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:26.387763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:26.452086 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:26.452054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:26.537013 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:26.536982    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:27.869791 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:27.869755    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:33.857180 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:33.857142    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:33.955480 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:33.955441    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:34.539169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:34.539130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:40.303002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:40.302964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:40.362792 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:40.362748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:40.446171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:40.446074    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:40.548090 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:40.548059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:43.412780 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:43.412748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:51.011166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:51.011125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:51.239234 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:51.239190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:56.468761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:56.468716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:59.225179 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:39:59.225140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:05.674482 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.674443    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"]
Sep 11 21:40:05.678353 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.678333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.680686 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.680661    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-db06d6\"/\"openshift-service-ca.crt\""
Sep 11 21:40:05.681890 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.681866    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-db06d6\"/\"kube-root-ca.crt\""
Sep 11 21:40:05.682000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.681887    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-db06d6\"/\"embedding-w0-db06d6-kserve-self-signed-certs\""
Sep 11 21:40:05.682060 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.682005    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-db06d6\"/\"default-dockercfg-vdx9q\""
Sep 11 21:40:05.687762 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.687739    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"]
Sep 11 21:40:05.691979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.691950    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:05.778028 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.777986    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tmp-dir\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.778028 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.778030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-dshm\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.778247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.778063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-home\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.778247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.778143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tls-certs\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.778247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.778203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fvwz\" (UniqueName: \"kubernetes.io/projected/a34a65cc-9ab9-401d-bb27-ad83210d03a7-kube-api-access-7fvwz\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.778247 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.778271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-model-cache\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879026 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.878986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tls-certs\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879217 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fvwz\" (UniqueName: \"kubernetes.io/projected/a34a65cc-9ab9-401d-bb27-ad83210d03a7-kube-api-access-7fvwz\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879217 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879110    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-model-cache\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879201    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tmp-dir\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879245    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-dshm\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-home\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879593 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-model-cache\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879723 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tmp-dir\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.879798 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.879748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-home\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.881473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.881450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-dshm\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.881604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.881588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tls-certs\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.886489 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.886472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fvwz\" (UniqueName: \"kubernetes.io/projected/a34a65cc-9ab9-401d-bb27-ad83210d03a7-kube-api-access-7fvwz\") pod \"embedding-w0-db06d6-kserve-58d7685766-pz2wr\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") " pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:05.989520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:05.989421    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:06.264179 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:06.264149    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"]
Sep 11 21:40:06.265299 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:40:06.265276    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda34a65cc_9ab9_401d_bb27_ad83210d03a7.slice/crio-c4e73f90fcc5a607b7f01147bf40eccb3b9220f54e2dd6a4d5d0529fb27b906e WatchSource:0}: Error finding container c4e73f90fcc5a607b7f01147bf40eccb3b9220f54e2dd6a4d5d0529fb27b906e: Status 404 returned error can't find the container with id c4e73f90fcc5a607b7f01147bf40eccb3b9220f54e2dd6a4d5d0529fb27b906e
Sep 11 21:40:06.281894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:06.281858    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr" event={"ID":"a34a65cc-9ab9-401d-bb27-ad83210d03a7","Type":"ContainerStarted","Data":"c4e73f90fcc5a607b7f01147bf40eccb3b9220f54e2dd6a4d5d0529fb27b906e"}
Sep 11 21:40:07.289474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:07.289429    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr" event={"ID":"a34a65cc-9ab9-401d-bb27-ad83210d03a7","Type":"ContainerStarted","Data":"bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc"}
Sep 11 21:40:07.305470 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:07.305418    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr" podStartSLOduration=2.305403862 podStartE2EDuration="2.305403862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:07.304614014 +0000 UTC m=+1369.616839381" watchObservedRunningTime="2026-09-11 21:40:07.305403862 +0000 UTC m=+1369.617629228"
Sep 11 21:40:12.192047 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:12.192009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:15.990134 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:15.990100    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:15.990571 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:15.990154    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:16.002742 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:16.002716    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:16.358034 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:16.358006    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:40:18.121692 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:18.121653    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:18.221461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:18.221426    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:18.474192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:18.474102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:18.811676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:18.811645    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:18.969340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:18.969300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:21.385647 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:21.385614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:22.176469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:22.176435    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:22.323744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:22.323707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:22.425417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:22.425381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:23.351526 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:23.351485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:24.250748 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:24.250711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:25.310414 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:25.310380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:26.026976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:26.026942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:26.712968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:26.712935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:27.672289 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.672232    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"]
Sep 11 21:40:27.676299 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.676276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.678780 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.678581    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-78e0f8-serving-cert\""
Sep 11 21:40:27.687180 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.687134    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"]
Sep 11 21:40:27.698021 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.697995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:27.796474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.796436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:27.818132 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.818099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-openshift-service-ca\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.818299 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.818151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-metrics-certs\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.818299 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.818180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjcw5\" (UniqueName: \"kubernetes.io/projected/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-kube-api-access-fjcw5\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.818299 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.818213    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-maas-api-tls\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.912612 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.912576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:27.918827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.918803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-maas-api-tls\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.918929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.918888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-openshift-service-ca\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.918929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.918923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-metrics-certs\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.919012 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.918949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcw5\" (UniqueName: \"kubernetes.io/projected/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-kube-api-access-fjcw5\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.919552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.919525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-openshift-service-ca\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.921295 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.921245    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-maas-api-tls\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.921295 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.921282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-metrics-certs\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.926172 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.926109    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjcw5\" (UniqueName: \"kubernetes.io/projected/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-kube-api-access-fjcw5\") pod \"maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:27.990456 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:27.990426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:28.257635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.257596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:28.266241 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.266209    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"]
Sep 11 21:40:28.267319 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:40:28.267290    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7153a5e_e8fa_4d3b_bbcd_586d50ebaded.slice/crio-28758f16f67bb3826f65b5b76e33a53f5b07436898827b9b47f3662210454313 WatchSource:0}: Error finding container 28758f16f67bb3826f65b5b76e33a53f5b07436898827b9b47f3662210454313: Status 404 returned error can't find the container with id 28758f16f67bb3826f65b5b76e33a53f5b07436898827b9b47f3662210454313
Sep 11 21:40:28.271872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.271845    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:40:28.355922 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.355882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:28.399301 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.399269    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"]
Sep 11 21:40:28.404184 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.404166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.406818 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.406794    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-78e0f8\""
Sep 11 21:40:28.407065 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.407045    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-78e0f8-dockercfg-wkdd6\""
Sep 11 21:40:28.413684 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.413660    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"]
Sep 11 21:40:28.424432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.424407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" event={"ID":"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded","Type":"ContainerStarted","Data":"28758f16f67bb3826f65b5b76e33a53f5b07436898827b9b47f3662210454313"}
Sep 11 21:40:28.526979 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.526899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-kube-api-access-8cxmk\") pod \"payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") " pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.527106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.527016    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") " pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.627779 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.627725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-kube-api-access-8cxmk\") pod \"payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") " pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.627981 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.627861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") " pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.628590 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.628565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") " pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.635421 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.635373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-kube-api-access-8cxmk\") pod \"payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") " pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.685948 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.685914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:28.717491 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.717459    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:28.990116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:28.990087    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"]
Sep 11 21:40:28.990857 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:40:28.990832    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a2f7a1_9ad3_4974_a3e4_e68cc288bfc6.slice/crio-7bc0d36f4b1d99523136245d1e314bbfdab73722abc0813cf766ec65d6fe9668 WatchSource:0}: Error finding container 7bc0d36f4b1d99523136245d1e314bbfdab73722abc0813cf766ec65d6fe9668: Status 404 returned error can't find the container with id 7bc0d36f4b1d99523136245d1e314bbfdab73722abc0813cf766ec65d6fe9668
Sep 11 21:40:29.432837 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.432801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6" event={"ID":"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6","Type":"ContainerStarted","Data":"dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5"}
Sep 11 21:40:29.433063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.432866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6" event={"ID":"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6","Type":"ContainerStarted","Data":"7bc0d36f4b1d99523136245d1e314bbfdab73722abc0813cf766ec65d6fe9668"}
Sep 11 21:40:29.433063 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.433009    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:29.434642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.434616    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" event={"ID":"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded","Type":"ContainerStarted","Data":"0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97"}
Sep 11 21:40:29.434761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.434699    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:29.464033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.464005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:29.466288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.466232    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6" podStartSLOduration=1.466217383 podStartE2EDuration="1.466217383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:29.462763736 +0000 UTC m=+1391.774989096" watchObservedRunningTime="2026-09-11 21:40:29.466217383 +0000 UTC m=+1391.778442772"
Sep 11 21:40:29.508032 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:29.507975    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" podStartSLOduration=2.077657586 podStartE2EDuration="2.507958285s" totalImagesPullingTime="430.300699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:29.504776991 +0000 UTC m=+1391.817002360" watchObservedRunningTime="2026-09-11 21:40:29.507958285 +0000 UTC m=+1391.820183650"
Sep 11 21:40:34.852067 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:34.852022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:34.954816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:34.954777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:35.445775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:35.445748    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:40:40.443291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:40.443240    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:40:49.884102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:49.884061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:50.603127 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:50.603091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:51.160603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:51.160565    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:51.317149 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:51.317117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:52.193169 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:52.193132    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:52.290550 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:52.290507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:52.720311 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:52.720244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:53.053019 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:53.052984    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:53.144972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:53.144917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:53.499693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:53.499659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:53.913150 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:53.913059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:54.805507 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:54.805466    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:55.826321 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:55.826219    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:56.442696 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:56.442638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:56.537764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:56.537732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:56.638405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:56.638365    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:57.369422 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:57.369387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:58.129000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:58.128966    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:58.906502 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:58.906468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:59.640971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:40:59.640933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:00.330728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:00.330691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:01.119627 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:01.119586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:01.890220 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:01.890189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:01.948001 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:01.947967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:02.440410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:02.440379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:02.540079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:02.540049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:02.617799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:02.617762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:02.909211 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:02.909174    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:03.795499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:03.795460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:24.184897 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:24.184857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:25.109801 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:25.109768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:25.998888 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:25.998853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:26.636093 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:26.636055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:27.027578 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:27.027540    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:27.923977 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:27.923940    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:28.704333 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:28.704292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:29.591948 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:29.591898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:30.431907 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:30.431866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:31.201987 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:31.201949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:31.894509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:31.894460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:32.596882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:32.596848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:33.420201 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:33.420154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:34.265892 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:34.265856    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:35.041386 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:35.041354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:36.020524 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:36.020474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:36.728445 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:36.728406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:37.504841 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:37.504806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:39.762816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:39.762768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:42.596418 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:42.596377    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.334473 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.334430    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"]
Sep 11 21:41:45.334957 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.334652    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" podUID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" containerName="maas-api" containerID="cri-o://0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97" gracePeriod=30
Sep 11 21:41:45.370102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.370065    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.441655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.441600    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" podUID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.85:8443/health\": dial tcp 10.132.0.85:8443: connect: connection refused"
Sep 11 21:41:45.466121 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.463741    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"]
Sep 11 21:41:45.466121 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.464186    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6" podUID="05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" containerName="payload-processing" containerID="cri-o://dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5" gracePeriod=30
Sep 11 21:41:45.501324 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.501272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.605647 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.605606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.619000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.618970    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:41:45.695190 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.695155    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-openshift-service-ca\") pod \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") "
Sep 11 21:41:45.695465 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.695236    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjcw5\" (UniqueName: \"kubernetes.io/projected/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-kube-api-access-fjcw5\") pod \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") "
Sep 11 21:41:45.695465 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.695302    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-metrics-certs\") pod \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") "
Sep 11 21:41:45.695465 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.695325    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-maas-api-tls\") pod \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\" (UID: \"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded\") "
Sep 11 21:41:45.695652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.695595    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" (UID: "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:45.695771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.695709    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.697711 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.697682    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" (UID: "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:41:45.699304 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.699275    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" (UID: "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:41:45.699449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.699424    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-kube-api-access-fjcw5" (OuterVolumeSpecName: "kube-api-access-fjcw5") pod "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" (UID: "c7153a5e-e8fa-4d3b-bbcd-586d50ebaded"). InnerVolumeSpecName "kube-api-access-fjcw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:41:45.700072 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.700040    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.729580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.729557    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:41:45.796365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.796334    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-kube-api-access-8cxmk\") pod \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") "
Sep 11 21:41:45.796529 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.796392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-plugins-config-volume\") pod \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\" (UID: \"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6\") "
Sep 11 21:41:45.796727 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.796713    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjcw5\" (UniqueName: \"kubernetes.io/projected/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-kube-api-access-fjcw5\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.796767 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.796733    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.796767 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.796745    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.796833 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.796784    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" (UID: "05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:45.798578 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.798559    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-kube-api-access-8cxmk" (OuterVolumeSpecName: "kube-api-access-8cxmk") pod "05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" (UID: "05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6"). InnerVolumeSpecName "kube-api-access-8cxmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:41:45.806096 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.806070    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.897820 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.897733    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cxmk\" (UniqueName: \"kubernetes.io/projected/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-kube-api-access-8cxmk\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.897820 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.897762    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:41:45.918779 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.918738    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:45.928162 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.928134    2572 generic.go:356] "Generic (PLEG): container finished" podID="05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" containerID="dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5" exitCode=0
Sep 11 21:41:45.928320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.928188    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"
Sep 11 21:41:45.928320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.928224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6" event={"ID":"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6","Type":"ContainerDied","Data":"dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5"}
Sep 11 21:41:45.928320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.928294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6" event={"ID":"05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6","Type":"ContainerDied","Data":"7bc0d36f4b1d99523136245d1e314bbfdab73722abc0813cf766ec65d6fe9668"}
Sep 11 21:41:45.928498 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.928323    2572 scope.go:117] "RemoveContainer" containerID="dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5"
Sep 11 21:41:45.929847 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.929823    2572 generic.go:356] "Generic (PLEG): container finished" podID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" containerID="0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97" exitCode=0
Sep 11 21:41:45.929975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.929857    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" event={"ID":"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded","Type":"ContainerDied","Data":"0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97"}
Sep 11 21:41:45.929975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.929870    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"
Sep 11 21:41:45.929975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.929911    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx" event={"ID":"c7153a5e-e8fa-4d3b-bbcd-586d50ebaded","Type":"ContainerDied","Data":"28758f16f67bb3826f65b5b76e33a53f5b07436898827b9b47f3662210454313"}
Sep 11 21:41:45.941028 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.941011    2572 scope.go:117] "RemoveContainer" containerID="dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5"
Sep 11 21:41:45.941338 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:41:45.941320    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5\": container with ID starting with dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5 not found: ID does not exist" containerID="dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5"
Sep 11 21:41:45.941385 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.941348    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5"} err="failed to get container status \"dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5\": rpc error: code = NotFound desc = could not find container \"dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5\": container with ID starting with dac2da8d2fc08ec22f5baeb9c6fc98e1ea9c442218c4f9031d19699b67cbbaf5 not found: ID does not exist"
Sep 11 21:41:45.941385 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.941364    2572 scope.go:117] "RemoveContainer" containerID="0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97"
Sep 11 21:41:45.950620 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.950599    2572 scope.go:117] "RemoveContainer" containerID="0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97"
Sep 11 21:41:45.950880 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:41:45.950861    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97\": container with ID starting with 0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97 not found: ID does not exist" containerID="0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97"
Sep 11 21:41:45.950944 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.950887    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97"} err="failed to get container status \"0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97\": rpc error: code = NotFound desc = could not find container \"0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97\": container with ID starting with 0224bdb1b0ae5deea139b5a20bd3b5c0d5997528ca75116b74e8aeb999baed97 not found: ID does not exist"
Sep 11 21:41:45.960816 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.960793    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"]
Sep 11 21:41:45.968854 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.968832    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78e0f8-77d6b9cf47-p5gk6"]
Sep 11 21:41:45.983567 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.983546    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"]
Sep 11 21:41:45.986132 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:45.986114    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78e0f8-7b5dd4f877-5kxkx"]
Sep 11 21:41:46.137159 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:46.137116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:46.143754 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:46.143729    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" path="/var/lib/kubelet/pods/05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6/volumes"
Sep 11 21:41:46.144126 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:46.144113    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" path="/var/lib/kubelet/pods/c7153a5e-e8fa-4d3b-bbcd-586d50ebaded/volumes"
Sep 11 21:41:46.936927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:46.936887    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:48.409146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:48.409109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:49.237815 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:49.237776    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:49.354765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:49.354725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:50.269380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:50.269349    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:51.001514 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:51.001449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:51.899803 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:51.899770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:52.353363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:52.353305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:52.452810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:52.452769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:52.602860 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:52.602823    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:52.703523 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:52.703443    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:53.501445 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:53.501411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:54.285003 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:54.284972    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"]
Sep 11 21:41:54.369152 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:54.369118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:54.458800 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:54.458762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:55.357396 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:55.357360    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:56.638340 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:56.638298    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:57.436033 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:57.435996    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:58.280850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:58.280814    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:59.000756 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:59.000713    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:59.767871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:41:59.767836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:05.573554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.573516    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"]
Sep 11 21:42:05.574141 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.573754    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" podUID="b75fb4dc-54c7-402c-b3f9-386d2e022b76" containerName="maas-api" containerID="cri-o://ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a" gracePeriod=30
Sep 11 21:42:05.605098 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.605064    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:05.692629 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.692601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:05.778770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.778720    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:05.827917 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.827853    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:42:05.864648 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.864585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:05.887146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.887109    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls\") pod \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") "
Sep 11 21:42:05.887335 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.887176    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75fb4dc-54c7-402c-b3f9-386d2e022b76-openshift-service-ca\") pod \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") "
Sep 11 21:42:05.887394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.887355    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58lr9\" (UniqueName: \"kubernetes.io/projected/b75fb4dc-54c7-402c-b3f9-386d2e022b76-kube-api-access-58lr9\") pod \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") "
Sep 11 21:42:05.887437 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.887393    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-metrics-certs\") pod \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\" (UID: \"b75fb4dc-54c7-402c-b3f9-386d2e022b76\") "
Sep 11 21:42:05.887575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.887550    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75fb4dc-54c7-402c-b3f9-386d2e022b76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b75fb4dc-54c7-402c-b3f9-386d2e022b76" (UID: "b75fb4dc-54c7-402c-b3f9-386d2e022b76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:05.887728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.887706    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75fb4dc-54c7-402c-b3f9-386d2e022b76-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:05.889597 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.889564    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75fb4dc-54c7-402c-b3f9-386d2e022b76-kube-api-access-58lr9" (OuterVolumeSpecName: "kube-api-access-58lr9") pod "b75fb4dc-54c7-402c-b3f9-386d2e022b76" (UID: "b75fb4dc-54c7-402c-b3f9-386d2e022b76"). InnerVolumeSpecName "kube-api-access-58lr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:05.889725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.889596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b75fb4dc-54c7-402c-b3f9-386d2e022b76" (UID: "b75fb4dc-54c7-402c-b3f9-386d2e022b76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:05.889725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.889611    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b75fb4dc-54c7-402c-b3f9-386d2e022b76" (UID: "b75fb4dc-54c7-402c-b3f9-386d2e022b76"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:05.988985 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.988941    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58lr9\" (UniqueName: \"kubernetes.io/projected/b75fb4dc-54c7-402c-b3f9-386d2e022b76-kube-api-access-58lr9\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:05.988985 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.988989    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:05.989189 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:05.989004    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b75fb4dc-54c7-402c-b3f9-386d2e022b76-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:06.064941 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.064905    2572 generic.go:356] "Generic (PLEG): container finished" podID="b75fb4dc-54c7-402c-b3f9-386d2e022b76" containerID="ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a" exitCode=0
Sep 11 21:42:06.065146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.064958    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"
Sep 11 21:42:06.065146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.064968    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" event={"ID":"b75fb4dc-54c7-402c-b3f9-386d2e022b76","Type":"ContainerDied","Data":"ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a"}
Sep 11 21:42:06.065146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.065009    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw" event={"ID":"b75fb4dc-54c7-402c-b3f9-386d2e022b76","Type":"ContainerDied","Data":"85358c73eebc1691e93d0cf3d111fe3cb1c5a02425afefd4ecad2a78bc18cc9d"}
Sep 11 21:42:06.065146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.065030    2572 scope.go:117] "RemoveContainer" containerID="ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a"
Sep 11 21:42:06.076672 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.076648    2572 scope.go:117] "RemoveContainer" containerID="ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a"
Sep 11 21:42:06.076982 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:42:06.076961    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a\": container with ID starting with ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a not found: ID does not exist" containerID="ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a"
Sep 11 21:42:06.077062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.076994    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a"} err="failed to get container status \"ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a\": rpc error: code = NotFound desc = could not find container \"ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a\": container with ID starting with ed3da585ac057b35cf1d21a5975c851d02a7f4010f0663efce458265290fe39a not found: ID does not exist"
Sep 11 21:42:06.091041 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.090955    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"]
Sep 11 21:42:06.095118 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.095086    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-db06d6-7b4d7d5dbc-ndjkw"]
Sep 11 21:42:06.144865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.144833    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75fb4dc-54c7-402c-b3f9-386d2e022b76" path="/var/lib/kubelet/pods/b75fb4dc-54c7-402c-b3f9-386d2e022b76/volumes"
Sep 11 21:42:06.198092 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.198050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:06.294545 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:06.294512    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:07.124768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:07.124723    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:08.062227 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:08.062193    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:09.134018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.133986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:09.305009 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.304951    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr" podUID="a34a65cc-9ab9-401d-bb27-ad83210d03a7" containerName="main" containerID="cri-o://bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc" gracePeriod=45
Sep 11 21:42:09.562970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.562941    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:42:09.621637 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621603    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fvwz\" (UniqueName: \"kubernetes.io/projected/a34a65cc-9ab9-401d-bb27-ad83210d03a7-kube-api-access-7fvwz\") pod \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") "
Sep 11 21:42:09.621812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-home\") pod \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") "
Sep 11 21:42:09.621812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621685    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-dshm\") pod \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") "
Sep 11 21:42:09.621812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621713    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tls-certs\") pod \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") "
Sep 11 21:42:09.621812 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tmp-dir\") pod \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") "
Sep 11 21:42:09.622054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621838    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-model-cache\") pod \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\" (UID: \"a34a65cc-9ab9-401d-bb27-ad83210d03a7\") "
Sep 11 21:42:09.622054 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.621953    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-home" (OuterVolumeSpecName: "home") pod "a34a65cc-9ab9-401d-bb27-ad83210d03a7" (UID: "a34a65cc-9ab9-401d-bb27-ad83210d03a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:09.622163 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.622084    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a34a65cc-9ab9-401d-bb27-ad83210d03a7" (UID: "a34a65cc-9ab9-401d-bb27-ad83210d03a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:09.622221 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.622158    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "a34a65cc-9ab9-401d-bb27-ad83210d03a7" (UID: "a34a65cc-9ab9-401d-bb27-ad83210d03a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:09.622315 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.622272    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tmp-dir\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:09.622315 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.622290    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-model-cache\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:09.622315 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.622305    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-home\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:09.623970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.623945    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a34a65cc-9ab9-401d-bb27-ad83210d03a7" (UID: "a34a65cc-9ab9-401d-bb27-ad83210d03a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:09.623970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.623964    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34a65cc-9ab9-401d-bb27-ad83210d03a7-kube-api-access-7fvwz" (OuterVolumeSpecName: "kube-api-access-7fvwz") pod "a34a65cc-9ab9-401d-bb27-ad83210d03a7" (UID: "a34a65cc-9ab9-401d-bb27-ad83210d03a7"). InnerVolumeSpecName "kube-api-access-7fvwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:09.624142 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.623968    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-dshm" (OuterVolumeSpecName: "dshm") pod "a34a65cc-9ab9-401d-bb27-ad83210d03a7" (UID: "a34a65cc-9ab9-401d-bb27-ad83210d03a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:42:09.723731 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.723645    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fvwz\" (UniqueName: \"kubernetes.io/projected/a34a65cc-9ab9-401d-bb27-ad83210d03a7-kube-api-access-7fvwz\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:09.723731 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.723677    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a34a65cc-9ab9-401d-bb27-ad83210d03a7-dshm\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:09.723731 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.723691    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a34a65cc-9ab9-401d-bb27-ad83210d03a7-tls-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:09.908351 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:09.908321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:10.094130 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.094098    2572 generic.go:356] "Generic (PLEG): container finished" podID="a34a65cc-9ab9-401d-bb27-ad83210d03a7" containerID="bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc" exitCode=0
Sep 11 21:42:10.094332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.094138    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"
Sep 11 21:42:10.094332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.094152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr" event={"ID":"a34a65cc-9ab9-401d-bb27-ad83210d03a7","Type":"ContainerDied","Data":"bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc"}
Sep 11 21:42:10.094332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.094185    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr" event={"ID":"a34a65cc-9ab9-401d-bb27-ad83210d03a7","Type":"ContainerDied","Data":"c4e73f90fcc5a607b7f01147bf40eccb3b9220f54e2dd6a4d5d0529fb27b906e"}
Sep 11 21:42:10.094332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.094202    2572 scope.go:117] "RemoveContainer" containerID="bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc"
Sep 11 21:42:10.104706 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.104687    2572 scope.go:117] "RemoveContainer" containerID="bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc"
Sep 11 21:42:10.104956 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:42:10.104937    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc\": container with ID starting with bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc not found: ID does not exist" containerID="bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc"
Sep 11 21:42:10.105002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.104964    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc"} err="failed to get container status \"bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc\": rpc error: code = NotFound desc = could not find container \"bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc\": container with ID starting with bfbd7e21e93cac16c2255faf9d31929627fd0a4bb42192c84d60b6a8cfbe65bc not found: ID does not exist"
Sep 11 21:42:10.124349 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.124321    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"]
Sep 11 21:42:10.128750 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.128726    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-db06d6/embedding-w0-db06d6-kserve-58d7685766-pz2wr"]
Sep 11 21:42:10.145056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.145026    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a34a65cc-9ab9-401d-bb27-ad83210d03a7" path="/var/lib/kubelet/pods/a34a65cc-9ab9-401d-bb27-ad83210d03a7/volumes"
Sep 11 21:42:10.642964 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:10.642916    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:11.311857 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:11.311826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:11.383339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:11.383300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:11.490212 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:11.490172    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:11.583677 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:11.583593    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:11.891860 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:11.891767    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:11.993506 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:11.993470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:12.700053 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:12.700023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:12.887963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:12.887923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:12.988009 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:12.987913    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:13.146604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:13.146566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:13.709471 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:13.709436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:14.537792 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:14.537755    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:15.344576 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:15.344542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:17.106326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:17.106294    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:17.940972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:17.940940    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:18.041382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:18.041352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:18.233472 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:18.233342    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:18.270111 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:18.270086    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:42:18.274986 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:18.274964    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:42:18.778718 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:18.778685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:19.591534 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:19.591497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:20.359919 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:20.359880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:21.021506 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:21.021461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:21.783214 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:21.783169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:22.649552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:22.649517    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:23.357470 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:23.357435    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.102882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.102843    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"]
Sep 11 21:42:29.103461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.103089    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw" podUID="85b3a4a0-e246-49f5-86ed-d04d8811f016" containerName="maas-api" containerID="cri-o://aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9" gracePeriod=30
Sep 11 21:42:29.128114 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.128089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.208839 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.208804    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.271728 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.271689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.341802 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.341769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.368673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.368613    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:42:29.402534 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.402502    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.528868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.528834    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b3a4a0-e246-49f5-86ed-d04d8811f016-openshift-service-ca\") pod \"85b3a4a0-e246-49f5-86ed-d04d8811f016\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") "
Sep 11 21:42:29.529032 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.528898    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-maas-api-tls\") pod \"85b3a4a0-e246-49f5-86ed-d04d8811f016\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") "
Sep 11 21:42:29.529432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.528989    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-metrics-certs\") pod \"85b3a4a0-e246-49f5-86ed-d04d8811f016\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") "
Sep 11 21:42:29.529625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.529577    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b3a4a0-e246-49f5-86ed-d04d8811f016-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "85b3a4a0-e246-49f5-86ed-d04d8811f016" (UID: "85b3a4a0-e246-49f5-86ed-d04d8811f016"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:29.530096 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.530070    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckr5r\" (UniqueName: \"kubernetes.io/projected/85b3a4a0-e246-49f5-86ed-d04d8811f016-kube-api-access-ckr5r\") pod \"85b3a4a0-e246-49f5-86ed-d04d8811f016\" (UID: \"85b3a4a0-e246-49f5-86ed-d04d8811f016\") "
Sep 11 21:42:29.532852 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.530724    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b3a4a0-e246-49f5-86ed-d04d8811f016-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.539544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.539508    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b3a4a0-e246-49f5-86ed-d04d8811f016-kube-api-access-ckr5r" (OuterVolumeSpecName: "kube-api-access-ckr5r") pod "85b3a4a0-e246-49f5-86ed-d04d8811f016" (UID: "85b3a4a0-e246-49f5-86ed-d04d8811f016"). InnerVolumeSpecName "kube-api-access-ckr5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:29.540740 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.540705    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "85b3a4a0-e246-49f5-86ed-d04d8811f016" (UID: "85b3a4a0-e246-49f5-86ed-d04d8811f016"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:29.540872 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.540846    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "85b3a4a0-e246-49f5-86ed-d04d8811f016" (UID: "85b3a4a0-e246-49f5-86ed-d04d8811f016"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:29.631657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.631571    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.631657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.631603    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckr5r\" (UniqueName: \"kubernetes.io/projected/85b3a4a0-e246-49f5-86ed-d04d8811f016-kube-api-access-ckr5r\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.631657 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.631614    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85b3a4a0-e246-49f5-86ed-d04d8811f016-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:29.698215 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.698182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:29.799209 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:29.799165    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:30.033977 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.033949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:30.221398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.221359    2572 generic.go:356] "Generic (PLEG): container finished" podID="85b3a4a0-e246-49f5-86ed-d04d8811f016" containerID="aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9" exitCode=0
Sep 11 21:42:30.221882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.221431    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"
Sep 11 21:42:30.221882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.221456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw" event={"ID":"85b3a4a0-e246-49f5-86ed-d04d8811f016","Type":"ContainerDied","Data":"aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9"}
Sep 11 21:42:30.221882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.221534    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw" event={"ID":"85b3a4a0-e246-49f5-86ed-d04d8811f016","Type":"ContainerDied","Data":"0170fcf4ae14733c5c8069f91c247692db325e827ec1f987855efa3e2ab8115f"}
Sep 11 21:42:30.221882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.221570    2572 scope.go:117] "RemoveContainer" containerID="aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9"
Sep 11 21:42:30.232189 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.232162    2572 scope.go:117] "RemoveContainer" containerID="aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9"
Sep 11 21:42:30.232497 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:42:30.232477    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9\": container with ID starting with aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9 not found: ID does not exist" containerID="aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9"
Sep 11 21:42:30.232579 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.232509    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9"} err="failed to get container status \"aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9\": rpc error: code = NotFound desc = could not find container \"aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9\": container with ID starting with aceac3ae1e31b17e6f29ae4c589d78eba941dfb619e0ae46c515e266b0f9dba9 not found: ID does not exist"
Sep 11 21:42:30.240535 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.240510    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"]
Sep 11 21:42:30.245091 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.245068    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-ad5be0-75c9868f7-h6ltw"]
Sep 11 21:42:30.634515 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:30.634464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:31.615321 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:31.615286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:32.144675 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:32.144643    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b3a4a0-e246-49f5-86ed-d04d8811f016" path="/var/lib/kubelet/pods/85b3a4a0-e246-49f5-86ed-d04d8811f016/volumes"
Sep 11 21:42:32.454613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:32.454509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:32.553391 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:32.553357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:32.654475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:32.654438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:33.234897 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:33.234834    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:34.390852 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:34.390816    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:35.140768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:35.140713    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:36.056296 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:36.056245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:36.186583 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:36.186542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:36.322348 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:36.322243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:37.460708 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:37.460673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:38.296039 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:38.296001    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:39.337171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:39.337139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:40.025910 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:40.025874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:40.803292 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:40.803243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:46.409932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.409894    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"]
Sep 11 21:42:46.412399 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.410152    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm" podUID="60464de7-47aa-4bdb-a4f1-966b56269275" containerName="maas-api" containerID="cri-o://c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c" gracePeriod=30
Sep 11 21:42:46.462052 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.462011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:46.551287 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.551232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:46.650288 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.650228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:46.668394 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.668330    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:42:46.751276 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.751226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:46.803085 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.803052    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-maas-api-tls\") pod \"60464de7-47aa-4bdb-a4f1-966b56269275\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") "
Sep 11 21:42:46.803301 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.803126    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60464de7-47aa-4bdb-a4f1-966b56269275-openshift-service-ca\") pod \"60464de7-47aa-4bdb-a4f1-966b56269275\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") "
Sep 11 21:42:46.803301 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.803215    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77257\" (UniqueName: \"kubernetes.io/projected/60464de7-47aa-4bdb-a4f1-966b56269275-kube-api-access-77257\") pod \"60464de7-47aa-4bdb-a4f1-966b56269275\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") "
Sep 11 21:42:46.803301 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.803279    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-metrics-certs\") pod \"60464de7-47aa-4bdb-a4f1-966b56269275\" (UID: \"60464de7-47aa-4bdb-a4f1-966b56269275\") "
Sep 11 21:42:46.803538 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.803512    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60464de7-47aa-4bdb-a4f1-966b56269275-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60464de7-47aa-4bdb-a4f1-966b56269275" (UID: "60464de7-47aa-4bdb-a4f1-966b56269275"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:46.805576 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.805546    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60464de7-47aa-4bdb-a4f1-966b56269275" (UID: "60464de7-47aa-4bdb-a4f1-966b56269275"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:46.805701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.805651    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60464de7-47aa-4bdb-a4f1-966b56269275-kube-api-access-77257" (OuterVolumeSpecName: "kube-api-access-77257") pod "60464de7-47aa-4bdb-a4f1-966b56269275" (UID: "60464de7-47aa-4bdb-a4f1-966b56269275"). InnerVolumeSpecName "kube-api-access-77257". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:46.805701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.805674    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "60464de7-47aa-4bdb-a4f1-966b56269275" (UID: "60464de7-47aa-4bdb-a4f1-966b56269275"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:46.904654 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.904622    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:46.904654 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.904650    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60464de7-47aa-4bdb-a4f1-966b56269275-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:46.904654 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.904660    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77257\" (UniqueName: \"kubernetes.io/projected/60464de7-47aa-4bdb-a4f1-966b56269275-kube-api-access-77257\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:46.904885 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:46.904669    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60464de7-47aa-4bdb-a4f1-966b56269275-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:47.081844 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.081796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:47.325183 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.325151    2572 generic.go:356] "Generic (PLEG): container finished" podID="60464de7-47aa-4bdb-a4f1-966b56269275" containerID="c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c" exitCode=0
Sep 11 21:42:47.325405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.325195    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"
Sep 11 21:42:47.325405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.325189    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm" event={"ID":"60464de7-47aa-4bdb-a4f1-966b56269275","Type":"ContainerDied","Data":"c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c"}
Sep 11 21:42:47.325405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.325338    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm" event={"ID":"60464de7-47aa-4bdb-a4f1-966b56269275","Type":"ContainerDied","Data":"7bfb6dbe8f526c85b1edc6b37928ce07270fd8f60036a5196e7a8a3076f58bcb"}
Sep 11 21:42:47.325405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.325372    2572 scope.go:117] "RemoveContainer" containerID="c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c"
Sep 11 21:42:47.336154 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.336135    2572 scope.go:117] "RemoveContainer" containerID="c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c"
Sep 11 21:42:47.336477 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:42:47.336457    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c\": container with ID starting with c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c not found: ID does not exist" containerID="c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c"
Sep 11 21:42:47.336548 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.336485    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c"} err="failed to get container status \"c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c\": rpc error: code = NotFound desc = could not find container \"c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c\": container with ID starting with c6369804fd181794447f67c8dc21bcfc7b44f13af82dbe67952c0f562a66af3c not found: ID does not exist"
Sep 11 21:42:47.356999 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.356961    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"]
Sep 11 21:42:47.361725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.361703    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-83ba87-89b9d4f8-jwgnm"]
Sep 11 21:42:47.718891 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:47.718801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:48.144568 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:48.144533    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60464de7-47aa-4bdb-a4f1-966b56269275" path="/var/lib/kubelet/pods/60464de7-47aa-4bdb-a4f1-966b56269275/volumes"
Sep 11 21:42:48.495272 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:48.495146    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:49.696999 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:49.696956    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:50.339160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.339126    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"]
Sep 11 21:42:50.341114 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.340225    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" podUID="cc1a91b6-5843-4592-aacd-a122a9ad94c0" containerName="maas-api" containerID="cri-o://203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8" gracePeriod=30
Sep 11 21:42:50.369095 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.368493    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:50.453673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.453623    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:50.517510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.517463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:50.592512 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.592401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:50.619499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.619469    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:42:50.667507 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.667456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:50.744580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.744551    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-metrics-certs\") pod \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") "
Sep 11 21:42:50.744580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.744587    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw7qh\" (UniqueName: \"kubernetes.io/projected/cc1a91b6-5843-4592-aacd-a122a9ad94c0-kube-api-access-zw7qh\") pod \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") "
Sep 11 21:42:50.745117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.744755    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls\") pod \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") "
Sep 11 21:42:50.745117 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.744875    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1a91b6-5843-4592-aacd-a122a9ad94c0-openshift-service-ca\") pod \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\" (UID: \"cc1a91b6-5843-4592-aacd-a122a9ad94c0\") "
Sep 11 21:42:50.745398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.745370    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1a91b6-5843-4592-aacd-a122a9ad94c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc1a91b6-5843-4592-aacd-a122a9ad94c0" (UID: "cc1a91b6-5843-4592-aacd-a122a9ad94c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:42:50.747300 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.747276    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc1a91b6-5843-4592-aacd-a122a9ad94c0" (UID: "cc1a91b6-5843-4592-aacd-a122a9ad94c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:50.747300 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.747277    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1a91b6-5843-4592-aacd-a122a9ad94c0-kube-api-access-zw7qh" (OuterVolumeSpecName: "kube-api-access-zw7qh") pod "cc1a91b6-5843-4592-aacd-a122a9ad94c0" (UID: "cc1a91b6-5843-4592-aacd-a122a9ad94c0"). InnerVolumeSpecName "kube-api-access-zw7qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:42:50.747640 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.747621    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cc1a91b6-5843-4592-aacd-a122a9ad94c0" (UID: "cc1a91b6-5843-4592-aacd-a122a9ad94c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:42:50.846698 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.846608    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1a91b6-5843-4592-aacd-a122a9ad94c0-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.846698 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.846636    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.846698 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.846646    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw7qh\" (UniqueName: \"kubernetes.io/projected/cc1a91b6-5843-4592-aacd-a122a9ad94c0-kube-api-access-zw7qh\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.846698 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.846655    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc1a91b6-5843-4592-aacd-a122a9ad94c0-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:42:50.950974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:50.950937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:51.056834 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.056792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:51.374280 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.374221    2572 generic.go:356] "Generic (PLEG): container finished" podID="cc1a91b6-5843-4592-aacd-a122a9ad94c0" containerID="203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8" exitCode=0
Sep 11 21:42:51.374475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.374289    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"
Sep 11 21:42:51.374475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.374304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" event={"ID":"cc1a91b6-5843-4592-aacd-a122a9ad94c0","Type":"ContainerDied","Data":"203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8"}
Sep 11 21:42:51.374475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.374356    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c" event={"ID":"cc1a91b6-5843-4592-aacd-a122a9ad94c0","Type":"ContainerDied","Data":"c0f0128dad871bb5b53acb685a4702b89e764beeba287edfeacaf68cacab9680"}
Sep 11 21:42:51.374475 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.374380    2572 scope.go:117] "RemoveContainer" containerID="203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8"
Sep 11 21:42:51.384804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.384785    2572 scope.go:117] "RemoveContainer" containerID="203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8"
Sep 11 21:42:51.385088 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:42:51.385066    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8\": container with ID starting with 203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8 not found: ID does not exist" containerID="203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8"
Sep 11 21:42:51.385158 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.385095    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8"} err="failed to get container status \"203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8\": rpc error: code = NotFound desc = could not find container \"203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8\": container with ID starting with 203bfb1eb81f7b0ca225c91bdd9e5dab551d62f5d6cda824e6d34881c0e4c2a8 not found: ID does not exist"
Sep 11 21:42:51.396847 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.396817    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"]
Sep 11 21:42:51.401015 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.400985    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-408219-7fbd4fdcb7-59k4c"]
Sep 11 21:42:51.792590 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:51.792559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:52.144266 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:52.144174    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1a91b6-5843-4592-aacd-a122a9ad94c0" path="/var/lib/kubelet/pods/cc1a91b6-5843-4592-aacd-a122a9ad94c0/volumes"
Sep 11 21:42:52.605656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:52.605622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:54.333993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:54.333961    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:57.408640 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:57.408606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:57.512521 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:57.512482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:57.695701 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:57.695608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:42:57.976053 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:42:57.975960    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:03.743671 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:03.743634    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:05.565684 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:05.565652    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"]
Sep 11 21:43:05.627171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:05.627136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:08.100333 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:08.100298    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"]
Sep 11 21:43:08.120652 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:08.120618    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:09.334322 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:09.334291    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:12.231536 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:12.231499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:12.331187 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:12.331152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:12.690647 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:12.690607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:17.156409 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:17.156373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:20.585968 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.585903    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk" podUID="cac3b235-da02-4eb7-8105-40ec1cae88f6" containerName="main" containerID="cri-o://1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb" gracePeriod=45
Sep 11 21:43:20.853669 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.853640    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:43:20.944946 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.944918    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-home\") pod \"cac3b235-da02-4eb7-8105-40ec1cae88f6\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") "
Sep 11 21:43:20.945143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945025    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-tmp-dir\") pod \"cac3b235-da02-4eb7-8105-40ec1cae88f6\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") "
Sep 11 21:43:20.945143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945062    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl2kl\" (UniqueName: \"kubernetes.io/projected/cac3b235-da02-4eb7-8105-40ec1cae88f6-kube-api-access-pl2kl\") pod \"cac3b235-da02-4eb7-8105-40ec1cae88f6\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") "
Sep 11 21:43:20.945143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945094    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-dshm\") pod \"cac3b235-da02-4eb7-8105-40ec1cae88f6\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") "
Sep 11 21:43:20.945143 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945114    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-model-cache\") pod \"cac3b235-da02-4eb7-8105-40ec1cae88f6\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") "
Sep 11 21:43:20.945392 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945162    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cac3b235-da02-4eb7-8105-40ec1cae88f6-tls-certs\") pod \"cac3b235-da02-4eb7-8105-40ec1cae88f6\" (UID: \"cac3b235-da02-4eb7-8105-40ec1cae88f6\") "
Sep 11 21:43:20.945392 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945181    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-home" (OuterVolumeSpecName: "home") pod "cac3b235-da02-4eb7-8105-40ec1cae88f6" (UID: "cac3b235-da02-4eb7-8105-40ec1cae88f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:20.945392 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945324    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cac3b235-da02-4eb7-8105-40ec1cae88f6" (UID: "cac3b235-da02-4eb7-8105-40ec1cae88f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:20.945539 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945406    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "cac3b235-da02-4eb7-8105-40ec1cae88f6" (UID: "cac3b235-da02-4eb7-8105-40ec1cae88f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:20.945600 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945572    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-tmp-dir\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:20.945600 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945586    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-model-cache\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:20.945600 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.945595    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-home\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:20.947320 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.947295    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cac3b235-da02-4eb7-8105-40ec1cae88f6-kube-api-access-pl2kl" (OuterVolumeSpecName: "kube-api-access-pl2kl") pod "cac3b235-da02-4eb7-8105-40ec1cae88f6" (UID: "cac3b235-da02-4eb7-8105-40ec1cae88f6"). InnerVolumeSpecName "kube-api-access-pl2kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:43:20.947449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.947328    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cac3b235-da02-4eb7-8105-40ec1cae88f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cac3b235-da02-4eb7-8105-40ec1cae88f6" (UID: "cac3b235-da02-4eb7-8105-40ec1cae88f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:43:20.947449 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:20.947341    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-dshm" (OuterVolumeSpecName: "dshm") pod "cac3b235-da02-4eb7-8105-40ec1cae88f6" (UID: "cac3b235-da02-4eb7-8105-40ec1cae88f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:21.046474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.046443    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cac3b235-da02-4eb7-8105-40ec1cae88f6-tls-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:21.046474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.046471    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl2kl\" (UniqueName: \"kubernetes.io/projected/cac3b235-da02-4eb7-8105-40ec1cae88f6-kube-api-access-pl2kl\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:21.046474 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.046480    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cac3b235-da02-4eb7-8105-40ec1cae88f6-dshm\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:21.556223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.556192    2572 generic.go:356] "Generic (PLEG): container finished" podID="cac3b235-da02-4eb7-8105-40ec1cae88f6" containerID="1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb" exitCode=0
Sep 11 21:43:21.556413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.556232    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"
Sep 11 21:43:21.556413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.556279    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk" event={"ID":"cac3b235-da02-4eb7-8105-40ec1cae88f6","Type":"ContainerDied","Data":"1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb"}
Sep 11 21:43:21.556413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.556322    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk" event={"ID":"cac3b235-da02-4eb7-8105-40ec1cae88f6","Type":"ContainerDied","Data":"632199e567a6a401edff0a75c6f231e1ce6580b2cef8e037acba89983ce25340"}
Sep 11 21:43:21.556413 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.556341    2572 scope.go:117] "RemoveContainer" containerID="1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb"
Sep 11 21:43:21.568405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.567377    2572 scope.go:117] "RemoveContainer" containerID="1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb"
Sep 11 21:43:21.568405 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:43:21.568347    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb\": container with ID starting with 1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb not found: ID does not exist" containerID="1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb"
Sep 11 21:43:21.568405 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.568380    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb"} err="failed to get container status \"1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb\": rpc error: code = NotFound desc = could not find container \"1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb\": container with ID starting with 1c7e6ce55609536cd3db294568d425358823356981b3902389069a5380afcbbb not found: ID does not exist"
Sep 11 21:43:21.578933 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.578909    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"]
Sep 11 21:43:21.582542 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:21.582519    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-c97420/auth-test-model-c97420-kserve-77c4b6fdbc-g2wgk"]
Sep 11 21:43:22.145043 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:22.145006    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cac3b235-da02-4eb7-8105-40ec1cae88f6" path="/var/lib/kubelet/pods/cac3b235-da02-4eb7-8105-40ec1cae88f6/volumes"
Sep 11 21:43:23.119922 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.119884    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb" podUID="7f50939c-ec5b-4b15-947d-afd1696a770d" containerName="main" containerID="cri-o://ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef" gracePeriod=45
Sep 11 21:43:23.377338 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.377275    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:43:23.470998 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.470965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-home\") pod \"7f50939c-ec5b-4b15-947d-afd1696a770d\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") "
Sep 11 21:43:23.470998 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.470998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f50939c-ec5b-4b15-947d-afd1696a770d-tls-certs\") pod \"7f50939c-ec5b-4b15-947d-afd1696a770d\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") "
Sep 11 21:43:23.471248 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471019    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj9jb\" (UniqueName: \"kubernetes.io/projected/7f50939c-ec5b-4b15-947d-afd1696a770d-kube-api-access-pj9jb\") pod \"7f50939c-ec5b-4b15-947d-afd1696a770d\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") "
Sep 11 21:43:23.471248 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471044    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-model-cache\") pod \"7f50939c-ec5b-4b15-947d-afd1696a770d\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") "
Sep 11 21:43:23.471248 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471092    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-dshm\") pod \"7f50939c-ec5b-4b15-947d-afd1696a770d\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") "
Sep 11 21:43:23.471248 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471125    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-tmp-dir\") pod \"7f50939c-ec5b-4b15-947d-afd1696a770d\" (UID: \"7f50939c-ec5b-4b15-947d-afd1696a770d\") "
Sep 11 21:43:23.471509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471328    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-home" (OuterVolumeSpecName: "home") pod "7f50939c-ec5b-4b15-947d-afd1696a770d" (UID: "7f50939c-ec5b-4b15-947d-afd1696a770d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:23.471509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471402    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f50939c-ec5b-4b15-947d-afd1696a770d" (UID: "7f50939c-ec5b-4b15-947d-afd1696a770d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:23.471509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471438    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f50939c-ec5b-4b15-947d-afd1696a770d" (UID: "7f50939c-ec5b-4b15-947d-afd1696a770d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:23.471509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471490    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-home\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:23.471509 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.471502    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-model-cache\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:23.473410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.473388    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f50939c-ec5b-4b15-947d-afd1696a770d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f50939c-ec5b-4b15-947d-afd1696a770d" (UID: "7f50939c-ec5b-4b15-947d-afd1696a770d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:43:23.473410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.473398    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-dshm" (OuterVolumeSpecName: "dshm") pod "7f50939c-ec5b-4b15-947d-afd1696a770d" (UID: "7f50939c-ec5b-4b15-947d-afd1696a770d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:43:23.473557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.473397    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f50939c-ec5b-4b15-947d-afd1696a770d-kube-api-access-pj9jb" (OuterVolumeSpecName: "kube-api-access-pj9jb") pod "7f50939c-ec5b-4b15-947d-afd1696a770d" (UID: "7f50939c-ec5b-4b15-947d-afd1696a770d"). InnerVolumeSpecName "kube-api-access-pj9jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:43:23.573681 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.573644    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-tmp-dir\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:23.573850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.573693    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f50939c-ec5b-4b15-947d-afd1696a770d-tls-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:23.573850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.573711    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj9jb\" (UniqueName: \"kubernetes.io/projected/7f50939c-ec5b-4b15-947d-afd1696a770d-kube-api-access-pj9jb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:23.573931 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.573885    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f50939c-ec5b-4b15-947d-afd1696a770d-dshm\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:43:23.577484 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.577461    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f50939c-ec5b-4b15-947d-afd1696a770d" containerID="ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef" exitCode=0
Sep 11 21:43:23.577604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.577518    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"
Sep 11 21:43:23.577604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.577539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb" event={"ID":"7f50939c-ec5b-4b15-947d-afd1696a770d","Type":"ContainerDied","Data":"ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef"}
Sep 11 21:43:23.577604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.577577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb" event={"ID":"7f50939c-ec5b-4b15-947d-afd1696a770d","Type":"ContainerDied","Data":"93f928d48679eb40b881c84b7a7f2e7d4af61657ddd301e4e7e87ea2eab468ba"}
Sep 11 21:43:23.577604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.577593    2572 scope.go:117] "RemoveContainer" containerID="ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef"
Sep 11 21:43:23.587012 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.586996    2572 scope.go:117] "RemoveContainer" containerID="ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef"
Sep 11 21:43:23.587282 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:43:23.587243    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef\": container with ID starting with ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef not found: ID does not exist" containerID="ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef"
Sep 11 21:43:23.587393 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.587287    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef"} err="failed to get container status \"ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef\": rpc error: code = NotFound desc = could not find container \"ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef\": container with ID starting with ae27748f823bcf0b0d6924efed134dcde4334bdde00ce6fb4195d16f65f166ef not found: ID does not exist"
Sep 11 21:43:23.599381 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.599352    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"]
Sep 11 21:43:23.603191 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:23.603170    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e0c211/auth-test-model-e0c211-kserve-6b5bfddcd7-k49qb"]
Sep 11 21:43:24.144102 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:24.144069    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f50939c-ec5b-4b15-947d-afd1696a770d" path="/var/lib/kubelet/pods/7f50939c-ec5b-4b15-947d-afd1696a770d/volumes"
Sep 11 21:43:38.726865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:38.726829    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:45.032154 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:45.032115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:51.178012 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:51.177973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:43:52.219606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:43:52.219574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:44:26.335971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.335928    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7810-5c8e4e"]
Sep 11 21:44:26.336606 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336584    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34a65cc-9ab9-401d-bb27-ad83210d03a7" containerName="main"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336609    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34a65cc-9ab9-401d-bb27-ad83210d03a7" containerName="main"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336620    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" containerName="payload-processing"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336629    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" containerName="payload-processing"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336643    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f50939c-ec5b-4b15-947d-afd1696a770d" containerName="main"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336652    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f50939c-ec5b-4b15-947d-afd1696a770d" containerName="main"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336670    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac3b235-da02-4eb7-8105-40ec1cae88f6" containerName="main"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336678    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac3b235-da02-4eb7-8105-40ec1cae88f6" containerName="main"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336688    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" containerName="maas-api"
Sep 11 21:44:26.336697 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336696    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336714    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1a91b6-5843-4592-aacd-a122a9ad94c0" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336722    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1a91b6-5843-4592-aacd-a122a9ad94c0" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336738    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60464de7-47aa-4bdb-a4f1-966b56269275" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336746    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="60464de7-47aa-4bdb-a4f1-966b56269275" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336784    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75fb4dc-54c7-402c-b3f9-386d2e022b76" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336794    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75fb4dc-54c7-402c-b3f9-386d2e022b76" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336804    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b3a4a0-e246-49f5-86ed-d04d8811f016" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336812    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b3a4a0-e246-49f5-86ed-d04d8811f016" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336909    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a2f7a1-9ad3-4974-a3e4-e68cc288bfc6" containerName="payload-processing"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336921    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b3a4a0-e246-49f5-86ed-d04d8811f016" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336933    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75fb4dc-54c7-402c-b3f9-386d2e022b76" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336943    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="60464de7-47aa-4bdb-a4f1-966b56269275" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336951    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f50939c-ec5b-4b15-947d-afd1696a770d" containerName="main"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336962    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7153a5e-e8fa-4d3b-bbcd-586d50ebaded" containerName="maas-api"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336971    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac3b235-da02-4eb7-8105-40ec1cae88f6" containerName="main"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336980    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a34a65cc-9ab9-401d-bb27-ad83210d03a7" containerName="main"
Sep 11 21:44:26.337160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.336992    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1a91b6-5843-4592-aacd-a122a9ad94c0" containerName="maas-api"
Sep 11 21:44:26.340398 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.340378    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:26.343043 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.343017    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ns82b\""
Sep 11 21:44:26.345719 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.345692    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7810-5c8e4e"]
Sep 11 21:44:26.372656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.372629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blrwp\" (UniqueName: \"kubernetes.io/projected/8e0eb381-5d20-411a-9d0c-bae7016e5fde-kube-api-access-blrwp\") pod \"test-curl-7810-5c8e4e\" (UID: \"8e0eb381-5d20-411a-9d0c-bae7016e5fde\") " pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:26.473610 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.473575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blrwp\" (UniqueName: \"kubernetes.io/projected/8e0eb381-5d20-411a-9d0c-bae7016e5fde-kube-api-access-blrwp\") pod \"test-curl-7810-5c8e4e\" (UID: \"8e0eb381-5d20-411a-9d0c-bae7016e5fde\") " pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:26.481666 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.481641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blrwp\" (UniqueName: \"kubernetes.io/projected/8e0eb381-5d20-411a-9d0c-bae7016e5fde-kube-api-access-blrwp\") pod \"test-curl-7810-5c8e4e\" (UID: \"8e0eb381-5d20-411a-9d0c-bae7016e5fde\") " pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:26.651517 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.651436    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:26.923189 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.923160    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7810-5c8e4e"]
Sep 11 21:44:26.924359 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:44:26.924333    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e0eb381_5d20_411a_9d0c_bae7016e5fde.slice/crio-d4eee08866ec7e59b8f6111522555bfd70dde0ed1443ab4f652fbceb8ca70498 WatchSource:0}: Error finding container d4eee08866ec7e59b8f6111522555bfd70dde0ed1443ab4f652fbceb8ca70498: Status 404 returned error can't find the container with id d4eee08866ec7e59b8f6111522555bfd70dde0ed1443ab4f652fbceb8ca70498
Sep 11 21:44:26.956236 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:26.956203    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7810-5c8e4e" event={"ID":"8e0eb381-5d20-411a-9d0c-bae7016e5fde","Type":"ContainerStarted","Data":"d4eee08866ec7e59b8f6111522555bfd70dde0ed1443ab4f652fbceb8ca70498"}
Sep 11 21:44:27.964039 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:27.964000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7810-5c8e4e" event={"ID":"8e0eb381-5d20-411a-9d0c-bae7016e5fde","Type":"ContainerStarted","Data":"e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8"}
Sep 11 21:44:27.978889 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:27.978848    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7810-5c8e4e" podStartSLOduration=1.978832876 podStartE2EDuration="1.978832876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:44:27.977926427 +0000 UTC m=+1630.290151796" watchObservedRunningTime="2026-09-11 21:44:27.978832876 +0000 UTC m=+1630.291058280"
Sep 11 21:44:28.596146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.596105    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7810-5c8e4e"]
Sep 11 21:44:28.600544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.600519    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7810-5c8e4e"]
Sep 11 21:44:28.721319 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.721223    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7810-1903c8"]
Sep 11 21:44:28.721696 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.721681    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" containerName="test-curl-7810-5c8e4e"
Sep 11 21:44:28.721744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.721698    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" containerName="test-curl-7810-5c8e4e"
Sep 11 21:44:28.721790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.721781    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" containerName="test-curl-7810-5c8e4e"
Sep 11 21:44:28.725047 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.725029    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:28.731418 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.731389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7810-1903c8"]
Sep 11 21:44:28.790230 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.790193    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbh8\" (UniqueName: \"kubernetes.io/projected/4e1f4237-e82f-4532-8f58-1083c079306e-kube-api-access-kpbh8\") pod \"test-curl-7810-1903c8\" (UID: \"4e1f4237-e82f-4532-8f58-1083c079306e\") " pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:28.890972 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.890931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbh8\" (UniqueName: \"kubernetes.io/projected/4e1f4237-e82f-4532-8f58-1083c079306e-kube-api-access-kpbh8\") pod \"test-curl-7810-1903c8\" (UID: \"4e1f4237-e82f-4532-8f58-1083c079306e\") " pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:28.898695 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:28.898669    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbh8\" (UniqueName: \"kubernetes.io/projected/4e1f4237-e82f-4532-8f58-1083c079306e-kube-api-access-kpbh8\") pod \"test-curl-7810-1903c8\" (UID: \"4e1f4237-e82f-4532-8f58-1083c079306e\") " pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:28.970033 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:28.970000    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7810-5c8e4e" container="test-curl-7810-5c8e4e"
Sep 11 21:44:29.036362 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:29.036333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:29.310761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:29.310734    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7810-1903c8"]
Sep 11 21:44:29.313181 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:44:29.313144    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e1f4237_e82f_4532_8f58_1083c079306e.slice/crio-1fdc13db2a7151dbc1806ab8dc31aa886ebd61116199f13d9b0c3d06aa0e22bc WatchSource:0}: Error finding container 1fdc13db2a7151dbc1806ab8dc31aa886ebd61116199f13d9b0c3d06aa0e22bc: Status 404 returned error can't find the container with id 1fdc13db2a7151dbc1806ab8dc31aa886ebd61116199f13d9b0c3d06aa0e22bc
Sep 11 21:44:29.977641 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:29.977602    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7810-1903c8" event={"ID":"4e1f4237-e82f-4532-8f58-1083c079306e","Type":"ContainerStarted","Data":"496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c"}
Sep 11 21:44:29.977641 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:29.977647    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7810-1903c8" event={"ID":"4e1f4237-e82f-4532-8f58-1083c079306e","Type":"ContainerStarted","Data":"1fdc13db2a7151dbc1806ab8dc31aa886ebd61116199f13d9b0c3d06aa0e22bc"}
Sep 11 21:44:29.978161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:29.977693    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7810-5c8e4e" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" containerName="test-curl-7810-5c8e4e" containerID="cri-o://e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8" gracePeriod=2
Sep 11 21:44:29.995471 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:29.995441    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-5c8e4e\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:29.996115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:29.996079    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7810-1903c8" podStartSLOduration=1.996065102 podStartE2EDuration="1.996065102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:44:29.99326525 +0000 UTC m=+1632.305490611" watchObservedRunningTime="2026-09-11 21:44:29.996065102 +0000 UTC m=+1632.308290467"
Sep 11 21:44:29.997411 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:29.997391    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-5c8e4e\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:30.590740 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:30.590704    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7810-1903c8"]
Sep 11 21:44:30.595408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:30.595065    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7810-1903c8"]
Sep 11 21:44:30.983307 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:30.983273    2572 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7810-1903c8" container="test-curl-7810-1903c8"
Sep 11 21:44:31.989716 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:31.989682    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7810-1903c8" podUID="4e1f4237-e82f-4532-8f58-1083c079306e" containerName="test-curl-7810-1903c8" containerID="cri-o://496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c" gracePeriod=2
Sep 11 21:44:31.992029 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:31.992003    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-1903c8\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="4e1f4237-e82f-4532-8f58-1083c079306e" pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:32.146634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.146603    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:32.215478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.215447    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blrwp\" (UniqueName: \"kubernetes.io/projected/8e0eb381-5d20-411a-9d0c-bae7016e5fde-kube-api-access-blrwp\") pod \"8e0eb381-5d20-411a-9d0c-bae7016e5fde\" (UID: \"8e0eb381-5d20-411a-9d0c-bae7016e5fde\") "
Sep 11 21:44:32.217481 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.217456    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0eb381-5d20-411a-9d0c-bae7016e5fde-kube-api-access-blrwp" (OuterVolumeSpecName: "kube-api-access-blrwp") pod "8e0eb381-5d20-411a-9d0c-bae7016e5fde" (UID: "8e0eb381-5d20-411a-9d0c-bae7016e5fde"). InnerVolumeSpecName "kube-api-access-blrwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:44:32.323573 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.317094    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blrwp\" (UniqueName: \"kubernetes.io/projected/8e0eb381-5d20-411a-9d0c-bae7016e5fde-kube-api-access-blrwp\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:44:32.617223 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.617136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:44:32.997014 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.996988    2572 generic.go:356] "Generic (PLEG): container finished" podID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" containerID="e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8" exitCode=137
Sep 11 21:44:32.997478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.997056    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:32.997478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:32.997092    2572 scope.go:117] "RemoveContainer" containerID="e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8"
Sep 11 21:44:33.007122 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:33.007106    2572 scope.go:117] "RemoveContainer" containerID="e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8"
Sep 11 21:44:33.007426 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:33.007408    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8\": container with ID starting with e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8 not found: ID does not exist" containerID="e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8"
Sep 11 21:44:33.007472 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:33.007437    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8"} err="failed to get container status \"e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8\": rpc error: code = NotFound desc = could not find container \"e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8\": container with ID starting with e53ad488fb9735752d88d43dcb613ce57b3a64bd3d87595c9467a634ae6e8de8 not found: ID does not exist"
Sep 11 21:44:33.008907 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:33.008884    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-5c8e4e\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:33.639451 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:33.639414    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:44:34.142022 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:34.141999    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:34.144670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:34.144647    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" path="/var/lib/kubelet/pods/8e0eb381-5d20-411a-9d0c-bae7016e5fde/volumes"
Sep 11 21:44:34.145190 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:34.145165    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-5c8e4e\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="8e0eb381-5d20-411a-9d0c-bae7016e5fde" pod="opendatahub/test-curl-7810-5c8e4e"
Sep 11 21:44:34.229775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:34.229745    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbh8\" (UniqueName: \"kubernetes.io/projected/4e1f4237-e82f-4532-8f58-1083c079306e-kube-api-access-kpbh8\") pod \"4e1f4237-e82f-4532-8f58-1083c079306e\" (UID: \"4e1f4237-e82f-4532-8f58-1083c079306e\") "
Sep 11 21:44:34.231804 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:34.231780    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1f4237-e82f-4532-8f58-1083c079306e-kube-api-access-kpbh8" (OuterVolumeSpecName: "kube-api-access-kpbh8") pod "4e1f4237-e82f-4532-8f58-1083c079306e" (UID: "4e1f4237-e82f-4532-8f58-1083c079306e"). InnerVolumeSpecName "kube-api-access-kpbh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:44:34.330581 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:34.330543    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbh8\" (UniqueName: \"kubernetes.io/projected/4e1f4237-e82f-4532-8f58-1083c079306e-kube-api-access-kpbh8\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:44:35.011467 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:35.011432    2572 generic.go:356] "Generic (PLEG): container finished" podID="4e1f4237-e82f-4532-8f58-1083c079306e" containerID="496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c" exitCode=137
Sep 11 21:44:35.011667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:35.011477    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-1903c8"
Sep 11 21:44:35.011667 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:35.011537    2572 scope.go:117] "RemoveContainer" containerID="496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c"
Sep 11 21:44:35.020577 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:35.020561    2572 scope.go:117] "RemoveContainer" containerID="496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c"
Sep 11 21:44:35.020843 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:44:35.020827    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c\": container with ID starting with 496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c not found: ID does not exist" containerID="496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c"
Sep 11 21:44:35.020894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:35.020850    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c"} err="failed to get container status \"496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c\": rpc error: code = NotFound desc = could not find container \"496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c\": container with ID starting with 496145d4d562a3ba2488414ebdea394866333f5dd2940f25649a937a6bc6f32c not found: ID does not exist"
Sep 11 21:44:36.143735 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:36.143699    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1f4237-e82f-4532-8f58-1083c079306e" path="/var/lib/kubelet/pods/4e1f4237-e82f-4532-8f58-1083c079306e/volumes"
Sep 11 21:44:36.813399 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:36.813360    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:44:58.911685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:44:58.911636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:00.133499 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.133455    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"]
Sep 11 21:45:00.133916 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.133902    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1f4237-e82f-4532-8f58-1083c079306e" containerName="test-curl-7810-1903c8"
Sep 11 21:45:00.133916 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.133917    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1f4237-e82f-4532-8f58-1083c079306e" containerName="test-curl-7810-1903c8"
Sep 11 21:45:00.134006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.133996    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1f4237-e82f-4532-8f58-1083c079306e" containerName="test-curl-7810-1903c8"
Sep 11 21:45:00.137338 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.137313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"
Sep 11 21:45:00.140181 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.140134    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nhbxk\""
Sep 11 21:45:00.152685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.152434    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"]
Sep 11 21:45:00.162755 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.162724    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"
Sep 11 21:45:00.435963 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:00.435933    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"]
Sep 11 21:45:00.437592 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:45:00.437561    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dac78d5_d30e_4a44_a456_3681b55f0d65.slice/crio-13789da838b15323dc80b1a198460f3d16098aa13bd25c5c0e68f1ac6cb8ad94 WatchSource:0}: Error finding container 13789da838b15323dc80b1a198460f3d16098aa13bd25c5c0e68f1ac6cb8ad94: Status 404 returned error can't find the container with id 13789da838b15323dc80b1a198460f3d16098aa13bd25c5c0e68f1ac6cb8ad94
Sep 11 21:45:01.175203 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:01.175172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr" event={"ID":"4dac78d5-d30e-4a44-a456-3681b55f0d65","Type":"ContainerStarted","Data":"13789da838b15323dc80b1a198460f3d16098aa13bd25c5c0e68f1ac6cb8ad94"}
Sep 11 21:45:03.189347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:03.189311    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr" event={"ID":"4dac78d5-d30e-4a44-a456-3681b55f0d65","Type":"ContainerStarted","Data":"fd1ab81457445868e1e73de237bbd466544259f1a545c95b23ebbab43c33a970"}
Sep 11 21:45:03.205781 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:03.205731    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr" podStartSLOduration=0.927493831 podStartE2EDuration="3.205715318s" totalImagesPullingTime="2.278221487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:03.204184066 +0000 UTC m=+1665.516409431" watchObservedRunningTime="2026-09-11 21:45:03.205715318 +0000 UTC m=+1665.517940683"
Sep 11 21:45:04.197446 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:04.197413    2572 generic.go:356] "Generic (PLEG): container finished" podID="4dac78d5-d30e-4a44-a456-3681b55f0d65" containerID="fd1ab81457445868e1e73de237bbd466544259f1a545c95b23ebbab43c33a970" exitCode=0
Sep 11 21:45:04.197836 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:04.197449    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr" event={"ID":"4dac78d5-d30e-4a44-a456-3681b55f0d65","Type":"ContainerDied","Data":"fd1ab81457445868e1e73de237bbd466544259f1a545c95b23ebbab43c33a970"}
Sep 11 21:45:05.342293 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:05.342262    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"
Sep 11 21:45:06.211544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:06.211509    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr" event={"ID":"4dac78d5-d30e-4a44-a456-3681b55f0d65","Type":"ContainerDied","Data":"13789da838b15323dc80b1a198460f3d16098aa13bd25c5c0e68f1ac6cb8ad94"}
Sep 11 21:45:06.211720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:06.211560    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13789da838b15323dc80b1a198460f3d16098aa13bd25c5c0e68f1ac6cb8ad94"
Sep 11 21:45:06.211720 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:06.211525    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819385-mttdr"
Sep 11 21:45:29.706670 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:29.706636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:30.623844 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:30.623807    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:31.060456 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:31.060425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:31.367061 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:31.366961    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:31.653559 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:31.653442    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:34.281568 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:34.281523    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:35.011048 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:35.011009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:35.142558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:35.142522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:36.521103 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:36.521057    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:37.625902 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.625870    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"]
Sep 11 21:45:37.626358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.626341    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dac78d5-d30e-4a44-a456-3681b55f0d65" containerName="cleanup"
Sep 11 21:45:37.626408 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.626360    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dac78d5-d30e-4a44-a456-3681b55f0d65" containerName="cleanup"
Sep 11 21:45:37.626460 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.626451    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dac78d5-d30e-4a44-a456-3681b55f0d65" containerName="cleanup"
Sep 11 21:45:37.630642 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.630617    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.633193 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.633176    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-9a6078-serving-cert\""
Sep 11 21:45:37.647531 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.647505    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"]
Sep 11 21:45:37.668532 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.668490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:37.715598 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.715554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjq77\" (UniqueName: \"kubernetes.io/projected/3c2124cd-606a-4bed-b736-4935678deebe-kube-api-access-kjq77\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.715771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.715647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c2124cd-606a-4bed-b736-4935678deebe-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.715771 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.715715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-metrics-certs\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.715851 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.715789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.766739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.766703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:37.817116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.817085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjq77\" (UniqueName: \"kubernetes.io/projected/3c2124cd-606a-4bed-b736-4935678deebe-kube-api-access-kjq77\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.817333 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.817131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c2124cd-606a-4bed-b736-4935678deebe-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.817333 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.817170    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-metrics-certs\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.817333 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.817213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.817532 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:45:37.817348    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-serving-cert: secret "maas-api-e2e-ipp-a-9a6078-serving-cert" not found
Sep 11 21:45:37.817532 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:45:37.817426    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls podName:3c2124cd-606a-4bed-b736-4935678deebe nodeName:}" failed. No retries permitted until 2026-09-11 21:45:38.317408407 +0000 UTC m=+1700.629633750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls") pod "maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" (UID: "3c2124cd-606a-4bed-b736-4935678deebe") : secret "maas-api-e2e-ipp-a-9a6078-serving-cert" not found
Sep 11 21:45:37.817912 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.817889    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c2124cd-606a-4bed-b736-4935678deebe-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.819578 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.819549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-metrics-certs\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:37.835757 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:37.835729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjq77\" (UniqueName: \"kubernetes.io/projected/3c2124cd-606a-4bed-b736-4935678deebe-kube-api-access-kjq77\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:38.010377 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.010340    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:38.322044 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.321963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:38.324690 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.324662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls\") pod \"maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:38.341560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.341519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:38.438240 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.438198    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:38.478961 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.478921    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"]
Sep 11 21:45:38.481678 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.481661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.484292 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.484270    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-9a6078-dockercfg-rptk8\""
Sep 11 21:45:38.484594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.484578    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-9a6078\""
Sep 11 21:45:38.494756 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.494733    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"]
Sep 11 21:45:38.523776 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.523742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wpxp\" (UniqueName: \"kubernetes.io/projected/852f0217-cdba-45b0-9b39-23dc0e0bef77-kube-api-access-9wpxp\") pod \"payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.523987 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.523874    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/852f0217-cdba-45b0-9b39-23dc0e0bef77-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.540635 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.540603    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:38.624911 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.624865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wpxp\" (UniqueName: \"kubernetes.io/projected/852f0217-cdba-45b0-9b39-23dc0e0bef77-kube-api-access-9wpxp\") pod \"payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.625088 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.624980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/852f0217-cdba-45b0-9b39-23dc0e0bef77-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.625971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.625883    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/852f0217-cdba-45b0-9b39-23dc0e0bef77-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.634359 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.634334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wpxp\" (UniqueName: \"kubernetes.io/projected/852f0217-cdba-45b0-9b39-23dc0e0bef77-kube-api-access-9wpxp\") pod \"payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.793035 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.793000    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:38.823827 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.823795    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"]
Sep 11 21:45:38.824395 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:45:38.824362    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2124cd_606a_4bed_b736_4935678deebe.slice/crio-d0b201b757e2d9f20748abf1d2f76dcb7e3522bab9d826e096e19c4a0591dace WatchSource:0}: Error finding container d0b201b757e2d9f20748abf1d2f76dcb7e3522bab9d826e096e19c4a0591dace: Status 404 returned error can't find the container with id d0b201b757e2d9f20748abf1d2f76dcb7e3522bab9d826e096e19c4a0591dace
Sep 11 21:45:38.826323 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:38.826302    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:45:39.082605 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:39.082571    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"]
Sep 11 21:45:39.083042 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:45:39.083018    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852f0217_cdba_45b0_9b39_23dc0e0bef77.slice/crio-71c79c1acea9dff52efb0bfed339f94ab65b055899b7a46b21840395be49f47b WatchSource:0}: Error finding container 71c79c1acea9dff52efb0bfed339f94ab65b055899b7a46b21840395be49f47b: Status 404 returned error can't find the container with id 71c79c1acea9dff52efb0bfed339f94ab65b055899b7a46b21840395be49f47b
Sep 11 21:45:39.422921 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:39.422889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" event={"ID":"3c2124cd-606a-4bed-b736-4935678deebe","Type":"ContainerStarted","Data":"d0b201b757e2d9f20748abf1d2f76dcb7e3522bab9d826e096e19c4a0591dace"}
Sep 11 21:45:39.424532 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:39.424503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw" event={"ID":"852f0217-cdba-45b0-9b39-23dc0e0bef77","Type":"ContainerStarted","Data":"2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0"}
Sep 11 21:45:39.424658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:39.424557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw" event={"ID":"852f0217-cdba-45b0-9b39-23dc0e0bef77","Type":"ContainerStarted","Data":"71c79c1acea9dff52efb0bfed339f94ab65b055899b7a46b21840395be49f47b"}
Sep 11 21:45:39.424658 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:39.424618    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:39.448875 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:39.447780    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw" podStartSLOduration=1.447757902 podStartE2EDuration="1.447757902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:39.442118745 +0000 UTC m=+1701.754344112" watchObservedRunningTime="2026-09-11 21:45:39.447757902 +0000 UTC m=+1701.759983272"
Sep 11 21:45:40.431853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:40.431758    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" event={"ID":"3c2124cd-606a-4bed-b736-4935678deebe","Type":"ContainerStarted","Data":"9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c"}
Sep 11 21:45:40.432291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:40.432021    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:40.453716 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:40.453666    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" podStartSLOduration=2.9135869149999998 podStartE2EDuration="3.453649476s" totalImagesPullingTime="540.062561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:40.450797819 +0000 UTC m=+1702.763023214" watchObservedRunningTime="2026-09-11 21:45:40.453649476 +0000 UTC m=+1702.765874842"
Sep 11 21:45:46.442881 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:46.442848    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:45:50.434352 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:50.434320    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:45:51.919424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:51.919388    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:45:59.906643 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:45:59.906605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:00.008196 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:00.008134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:00.580792 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:00.580750    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:00.812268 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:00.812222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:00.906157 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:00.906067    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:01.063510 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:01.063477    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:01.897353 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:01.897318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:02.570664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:02.570628    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:03.627868 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:03.627831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:04.047682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:04.047647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:04.207380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:04.207337    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:04.696197 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:04.696166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:05.675802 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:05.675766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:06.506200 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:06.506157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:07.503970 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:07.503931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:07.576186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:07.576120    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:07.998746 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:07.998715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:08.095115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:08.095080    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:26.310853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:26.310805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:26.375000 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:26.374963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:29.651673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:29.651634    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:30.406127 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:30.406087    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:31.089427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:31.089392    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:31.831575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:31.831542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:32.621976 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:32.621944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:34.157226 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:34.157195    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:38.307469 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:38.307429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:46.872016 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:46.871981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:46:54.600830 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:46:54.600794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:18.313353 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:18.313325    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:47:18.320784 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:18.320754    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:47:21.753378 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:21.753339    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:25.509753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:25.509716    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw_852f0217-cdba-45b0-9b39-23dc0e0bef77/payload-processing/0.log"
Sep 11 21:47:26.048960 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:26.048924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:26.370941 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:26.370847    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:26.734724 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:26.734694    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:28.720776 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:28.720739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:29.432314 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:29.432276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:29.534974 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:29.534932    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:29.747407 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:29.747377    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:30.563719 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:30.563679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:31.364515 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:31.364476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:32.285984 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:32.285942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:33.080726 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.080687    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:33.242978 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.242944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:33.348229 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.348141    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:33.683282 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.683168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:33.822549 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.822513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:33.989938 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.989848    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"]
Sep 11 21:47:33.993514 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.993484    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:33.996009 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.995985    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-13e3ee\""
Sep 11 21:47:33.996113 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:33.996038    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-13e3ee-dockercfg-55bqt\""
Sep 11 21:47:34.005186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.005161    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"]
Sep 11 21:47:34.060686 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.060647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.060874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.060812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zz6\" (UniqueName: \"kubernetes.io/projected/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-kube-api-access-76zz6\") pod \"payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.162146 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.162106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zz6\" (UniqueName: \"kubernetes.io/projected/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-kube-api-access-76zz6\") pod \"payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.162613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.162300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.163010 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.162989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.170095 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.170073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zz6\" (UniqueName: \"kubernetes.io/projected/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-kube-api-access-76zz6\") pod \"payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.305436 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.305401    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:34.583411 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:34.583378    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"]
Sep 11 21:47:34.584133 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:47:34.584109    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e3bdc3_be8c_47e0_8c5e_dc1719c1ef74.slice/crio-d2de4ef207a5d6ae479747126142c77d95bd8111e5268c1521160ab7606d1041 WatchSource:0}: Error finding container d2de4ef207a5d6ae479747126142c77d95bd8111e5268c1521160ab7606d1041: Status 404 returned error can't find the container with id d2de4ef207a5d6ae479747126142c77d95bd8111e5268c1521160ab7606d1041
Sep 11 21:47:35.116199 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:35.116162    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb" event={"ID":"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74","Type":"ContainerStarted","Data":"c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd"}
Sep 11 21:47:35.116423 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:35.116226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb" event={"ID":"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74","Type":"ContainerStarted","Data":"d2de4ef207a5d6ae479747126142c77d95bd8111e5268c1521160ab7606d1041"}
Sep 11 21:47:35.116423 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:35.116279    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:35.137153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:35.137100    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb" podStartSLOduration=2.137084418 podStartE2EDuration="2.137084418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:47:35.133723047 +0000 UTC m=+1817.445948413" watchObservedRunningTime="2026-09-11 21:47:35.137084418 +0000 UTC m=+1817.449309783"
Sep 11 21:47:46.125193 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:46.125151    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:47:49.400106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:49.400063    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:55.286339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:55.286299    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:56.543059 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:56.543018    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:56.904894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:56.904806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:57.660783 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:57.660725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:58.492664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:58.492632    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:59.209950 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:59.209912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:47:59.541560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:47:59.541526    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:01.100664 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:01.100620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:01.911478 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:01.911436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:02.599995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:02.599957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:03.413829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:03.413792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:04.215264 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:04.215226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:05.156950 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:05.156913    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:11.349346 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.349298    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:11.379371 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.379338    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"]
Sep 11 21:48:11.379655 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.379626    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb" podUID="63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" containerName="payload-processing" containerID="cri-o://c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd" gracePeriod=30
Sep 11 21:48:11.426549 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.426516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:11.523554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.523522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:11.601004 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.600897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:11.642855 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.642829    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:48:11.718929 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.718893    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-plugins-config-volume\") pod \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") "
Sep 11 21:48:11.719099 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.719033    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76zz6\" (UniqueName: \"kubernetes.io/projected/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-kube-api-access-76zz6\") pod \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\" (UID: \"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74\") "
Sep 11 21:48:11.719264 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.719227    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" (UID: "63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:11.719407 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.719386    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:11.721461 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.721433    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-kube-api-access-76zz6" (OuterVolumeSpecName: "kube-api-access-76zz6") pod "63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" (UID: "63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74"). InnerVolumeSpecName "kube-api-access-76zz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:48:11.820746 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.820704    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76zz6\" (UniqueName: \"kubernetes.io/projected/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74-kube-api-access-76zz6\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:11.938867 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:11.938770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:12.040419 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.040381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:12.349159 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.349121    2572 generic.go:356] "Generic (PLEG): container finished" podID="63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" containerID="c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd" exitCode=0
Sep 11 21:48:12.349370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.349174    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"
Sep 11 21:48:12.349370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.349200    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb" event={"ID":"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74","Type":"ContainerDied","Data":"c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd"}
Sep 11 21:48:12.349370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.349291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb" event={"ID":"63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74","Type":"ContainerDied","Data":"d2de4ef207a5d6ae479747126142c77d95bd8111e5268c1521160ab7606d1041"}
Sep 11 21:48:12.349370 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.349316    2572 scope.go:117] "RemoveContainer" containerID="c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd"
Sep 11 21:48:12.359029 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.359006    2572 scope.go:117] "RemoveContainer" containerID="c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd"
Sep 11 21:48:12.359319 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:48:12.359295    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd\": container with ID starting with c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd not found: ID does not exist" containerID="c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd"
Sep 11 21:48:12.359417 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.359324    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd"} err="failed to get container status \"c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd\": rpc error: code = NotFound desc = could not find container \"c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd\": container with ID starting with c0c93cd520bd612a2ea3ea531caf3588426e314c0bf07748558951b52176a7fd not found: ID does not exist"
Sep 11 21:48:12.373079 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.373053    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"]
Sep 11 21:48:12.381831 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.381805    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-13e3ee-6467987d7-sfhmb"]
Sep 11 21:48:12.783759 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:12.783722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:13.790213 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:13.790179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:14.147629 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:14.147537    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" path="/var/lib/kubelet/pods/63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74/volumes"
Sep 11 21:48:14.591156 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:14.591125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:15.321712 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:15.321643    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:18.166600 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:18.166556    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:18.242161 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:18.242127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:18.454762 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:18.454669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:22.316892 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:22.316851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:23.284645 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:23.284612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:24.113135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:24.113083    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:24.806671 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:24.806624    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:25.575083 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:25.575046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:26.275075 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:26.275031    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:28.146077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:28.146038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:28.196761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:28.196726    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:37.715906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.715870    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"]
Sep 11 21:48:37.716349 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.716128    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" podUID="3c2124cd-606a-4bed-b736-4935678deebe" containerName="maas-api" containerID="cri-o://9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c" gracePeriod=30
Sep 11 21:48:37.764324 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.764285    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:37.783939 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.780282    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"]
Sep 11 21:48:37.783939 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.781588    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw" podUID="852f0217-cdba-45b0-9b39-23dc0e0bef77" containerName="payload-processing" containerID="cri-o://2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0" gracePeriod=30
Sep 11 21:48:37.864082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.864043    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:37.946115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:37.946036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:38.009459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.009418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:38.047913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.047886    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:48:38.082428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.082401    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:48:38.173552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.173522    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjq77\" (UniqueName: \"kubernetes.io/projected/3c2124cd-606a-4bed-b736-4935678deebe-kube-api-access-kjq77\") pod \"3c2124cd-606a-4bed-b736-4935678deebe\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") "
Sep 11 21:48:38.173552 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.173558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/852f0217-cdba-45b0-9b39-23dc0e0bef77-plugins-config-volume\") pod \"852f0217-cdba-45b0-9b39-23dc0e0bef77\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") "
Sep 11 21:48:38.173775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.173609    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls\") pod \"3c2124cd-606a-4bed-b736-4935678deebe\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") "
Sep 11 21:48:38.173775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.173637    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wpxp\" (UniqueName: \"kubernetes.io/projected/852f0217-cdba-45b0-9b39-23dc0e0bef77-kube-api-access-9wpxp\") pod \"852f0217-cdba-45b0-9b39-23dc0e0bef77\" (UID: \"852f0217-cdba-45b0-9b39-23dc0e0bef77\") "
Sep 11 21:48:38.173775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.173667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c2124cd-606a-4bed-b736-4935678deebe-openshift-service-ca\") pod \"3c2124cd-606a-4bed-b736-4935678deebe\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") "
Sep 11 21:48:38.173775 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.173708    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-metrics-certs\") pod \"3c2124cd-606a-4bed-b736-4935678deebe\" (UID: \"3c2124cd-606a-4bed-b736-4935678deebe\") "
Sep 11 21:48:38.174065 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.174033    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852f0217-cdba-45b0-9b39-23dc0e0bef77-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "852f0217-cdba-45b0-9b39-23dc0e0bef77" (UID: "852f0217-cdba-45b0-9b39-23dc0e0bef77"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:38.174179 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.174064    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c2124cd-606a-4bed-b736-4935678deebe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c2124cd-606a-4bed-b736-4935678deebe" (UID: "3c2124cd-606a-4bed-b736-4935678deebe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:48:38.175862 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.175838    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c2124cd-606a-4bed-b736-4935678deebe" (UID: "3c2124cd-606a-4bed-b736-4935678deebe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:48:38.175945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.175880    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852f0217-cdba-45b0-9b39-23dc0e0bef77-kube-api-access-9wpxp" (OuterVolumeSpecName: "kube-api-access-9wpxp") pod "852f0217-cdba-45b0-9b39-23dc0e0bef77" (UID: "852f0217-cdba-45b0-9b39-23dc0e0bef77"). InnerVolumeSpecName "kube-api-access-9wpxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:48:38.176153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.176131    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c2124cd-606a-4bed-b736-4935678deebe" (UID: "3c2124cd-606a-4bed-b736-4935678deebe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:48:38.176192 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.176144    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2124cd-606a-4bed-b736-4935678deebe-kube-api-access-kjq77" (OuterVolumeSpecName: "kube-api-access-kjq77") pod "3c2124cd-606a-4bed-b736-4935678deebe" (UID: "3c2124cd-606a-4bed-b736-4935678deebe"). InnerVolumeSpecName "kube-api-access-kjq77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:48:38.275339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.275308    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wpxp\" (UniqueName: \"kubernetes.io/projected/852f0217-cdba-45b0-9b39-23dc0e0bef77-kube-api-access-9wpxp\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.275339 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.275337    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c2124cd-606a-4bed-b736-4935678deebe-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.275541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.275347    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.275541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.275356    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjq77\" (UniqueName: \"kubernetes.io/projected/3c2124cd-606a-4bed-b736-4935678deebe-kube-api-access-kjq77\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.275541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.275365    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/852f0217-cdba-45b0-9b39-23dc0e0bef77-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.275541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.275374    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c2124cd-606a-4bed-b736-4935678deebe-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:48:38.376451 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.376411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:38.508025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.507978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:38.512373 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.512343    2572 generic.go:356] "Generic (PLEG): container finished" podID="3c2124cd-606a-4bed-b736-4935678deebe" containerID="9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c" exitCode=0
Sep 11 21:48:38.512524 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.512409    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"
Sep 11 21:48:38.512524 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.512409    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" event={"ID":"3c2124cd-606a-4bed-b736-4935678deebe","Type":"ContainerDied","Data":"9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c"}
Sep 11 21:48:38.512524 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.512473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m" event={"ID":"3c2124cd-606a-4bed-b736-4935678deebe","Type":"ContainerDied","Data":"d0b201b757e2d9f20748abf1d2f76dcb7e3522bab9d826e096e19c4a0591dace"}
Sep 11 21:48:38.512937 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.512504    2572 scope.go:117] "RemoveContainer" containerID="9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c"
Sep 11 21:48:38.514082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.514049    2572 generic.go:356] "Generic (PLEG): container finished" podID="852f0217-cdba-45b0-9b39-23dc0e0bef77" containerID="2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0" exitCode=0
Sep 11 21:48:38.514186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.514087    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"
Sep 11 21:48:38.514186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.514140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw" event={"ID":"852f0217-cdba-45b0-9b39-23dc0e0bef77","Type":"ContainerDied","Data":"2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0"}
Sep 11 21:48:38.514332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.514193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw" event={"ID":"852f0217-cdba-45b0-9b39-23dc0e0bef77","Type":"ContainerDied","Data":"71c79c1acea9dff52efb0bfed339f94ab65b055899b7a46b21840395be49f47b"}
Sep 11 21:48:38.523557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.523540    2572 scope.go:117] "RemoveContainer" containerID="9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c"
Sep 11 21:48:38.523916 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:48:38.523894    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c\": container with ID starting with 9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c not found: ID does not exist" containerID="9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c"
Sep 11 21:48:38.524011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.523927    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c"} err="failed to get container status \"9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c\": rpc error: code = NotFound desc = could not find container \"9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c\": container with ID starting with 9a7865f440a7e36d149a1906a95cba51190be91a13cf10dd505146e613ade48c not found: ID does not exist"
Sep 11 21:48:38.524011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.523951    2572 scope.go:117] "RemoveContainer" containerID="2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0"
Sep 11 21:48:38.532604 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.532584    2572 scope.go:117] "RemoveContainer" containerID="2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0"
Sep 11 21:48:38.532862 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:48:38.532844    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0\": container with ID starting with 2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0 not found: ID does not exist" containerID="2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0"
Sep 11 21:48:38.532906 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.532869    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0"} err="failed to get container status \"2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0\": rpc error: code = NotFound desc = could not find container \"2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0\": container with ID starting with 2fac5c8b6808b5a91fad21488f9a65e12829af5bf352912897c52fdfa35fa6f0 not found: ID does not exist"
Sep 11 21:48:38.548031 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.548004    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"]
Sep 11 21:48:38.564327 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.564304    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-9a6078-59bc69957f-2zm6m"]
Sep 11 21:48:38.579713 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.579679    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"]
Sep 11 21:48:38.590859 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:38.590831    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9a6078-56bdb686b7-p7qcw"]
Sep 11 21:48:39.298975 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:39.298942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:40.141722 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:40.141682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:40.144649 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:40.144624    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2124cd-606a-4bed-b736-4935678deebe" path="/var/lib/kubelet/pods/3c2124cd-606a-4bed-b736-4935678deebe/volumes"
Sep 11 21:48:40.145007 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:40.144994    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="852f0217-cdba-45b0-9b39-23dc0e0bef77" path="/var/lib/kubelet/pods/852f0217-cdba-45b0-9b39-23dc0e0bef77/volumes"
Sep 11 21:48:40.865116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:40.865075    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:48:43.409109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:48:43.409070    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:19.568342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:19.568305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:20.653189 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:20.653155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:26.167358 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:26.167323    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:31.730342 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:31.730305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:31.802112 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:31.802078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:32.035861 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:32.035826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:32.626287 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:32.626239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:33.546347 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:33.546293    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:34.208316 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:34.208238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:35.121533 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:35.121484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:35.831719 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:35.831688    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:42.933390 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:42.933352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:43.003341 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:43.003304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:43.065994 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:43.065960    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:43.132841 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:43.132803    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:43.210656 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:43.210563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:43.510332 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:43.510295    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:43.609538 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:43.609495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:44.323683 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:44.323646    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:44.416180 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:44.416144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:45.082613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:45.082572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:49.489887 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:49.489850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:49.590116 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:49.590081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:49.752432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:49.752395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:50.802471 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:50.802434    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:51.603315 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:51.603277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:49:52.381376 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:49:52.381344    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:00.607004 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.606969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:00.638554 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.638515    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"]
Sep 11 21:50:00.638871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.638818    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85" podUID="8f2a155f-3c2c-4798-8735-e1fea010955c" containerName="payload-processing" containerID="cri-o://c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91" gracePeriod=30
Sep 11 21:50:00.704158 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.704114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:00.803819 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.803785    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:00.902940 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.902915    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:50:00.913481 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:00.913446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:01.002625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.002593    2572 generic.go:356] "Generic (PLEG): container finished" podID="8f2a155f-3c2c-4798-8735-e1fea010955c" containerID="c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91" exitCode=0
Sep 11 21:50:01.002835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.002658    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"
Sep 11 21:50:01.002835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.002689    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85" event={"ID":"8f2a155f-3c2c-4798-8735-e1fea010955c","Type":"ContainerDied","Data":"c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91"}
Sep 11 21:50:01.002835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.002760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85" event={"ID":"8f2a155f-3c2c-4798-8735-e1fea010955c","Type":"ContainerDied","Data":"379a2816b95753a0d3c5ffdb36c7972620814c94ce2801aee52ac9b84da3388d"}
Sep 11 21:50:01.002835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.002792    2572 scope.go:117] "RemoveContainer" containerID="c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91"
Sep 11 21:50:01.014443 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.014414    2572 scope.go:117] "RemoveContainer" containerID="c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91"
Sep 11 21:50:01.014924 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:50:01.014899    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91\": container with ID starting with c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91 not found: ID does not exist" containerID="c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91"
Sep 11 21:50:01.015032 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.014930    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91"} err="failed to get container status \"c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91\": rpc error: code = NotFound desc = could not find container \"c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91\": container with ID starting with c571580d379cca0bee40d41091a3fda0dd0f4dae9fb2f25b9180c5d7add48a91 not found: ID does not exist"
Sep 11 21:50:01.064235 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.064198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2a155f-3c2c-4798-8735-e1fea010955c-plugins-config-volume\") pod \"8f2a155f-3c2c-4798-8735-e1fea010955c\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") "
Sep 11 21:50:01.064424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.064318    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psxnl\" (UniqueName: \"kubernetes.io/projected/8f2a155f-3c2c-4798-8735-e1fea010955c-kube-api-access-psxnl\") pod \"8f2a155f-3c2c-4798-8735-e1fea010955c\" (UID: \"8f2a155f-3c2c-4798-8735-e1fea010955c\") "
Sep 11 21:50:01.064682 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.064654    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2a155f-3c2c-4798-8735-e1fea010955c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f2a155f-3c2c-4798-8735-e1fea010955c" (UID: "8f2a155f-3c2c-4798-8735-e1fea010955c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:01.066448 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.066413    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2a155f-3c2c-4798-8735-e1fea010955c-kube-api-access-psxnl" (OuterVolumeSpecName: "kube-api-access-psxnl") pod "8f2a155f-3c2c-4798-8735-e1fea010955c" (UID: "8f2a155f-3c2c-4798-8735-e1fea010955c"). InnerVolumeSpecName "kube-api-access-psxnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:01.165770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.165677    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2a155f-3c2c-4798-8735-e1fea010955c-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:01.165770 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.165713    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psxnl\" (UniqueName: \"kubernetes.io/projected/8f2a155f-3c2c-4798-8735-e1fea010955c-kube-api-access-psxnl\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:01.218826 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.218775    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:01.325010 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.324972    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:01.325634 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.325610    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"]
Sep 11 21:50:01.329427 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:01.329405    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-c97420-6f4864d77-vdn85"]
Sep 11 21:50:02.011857 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:02.011818    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:02.143341 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:02.143304    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2a155f-3c2c-4798-8735-e1fea010955c" path="/var/lib/kubelet/pods/8f2a155f-3c2c-4798-8735-e1fea010955c/volumes"
Sep 11 21:50:07.064153 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:07.064112    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:07.135781 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:07.135749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:07.329709 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:07.329612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:08.398835 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:08.398799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:09.260676 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:09.260644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:18.259515 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.259481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:18.281532 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.281494    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"]
Sep 11 21:50:18.281744 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.281712    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw" podUID="7f62f00f-1a50-477b-bf7a-83bc167f8f20" containerName="payload-processing" containerID="cri-o://8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33" gracePeriod=30
Sep 11 21:50:18.293312 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.293283    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"]
Sep 11 21:50:18.293592 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.293553    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl" podUID="890d12a6-14a9-4a9c-975c-b769fce05fc1" containerName="payload-pre-processing" containerID="cri-o://3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1" gracePeriod=30
Sep 11 21:50:18.355344 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.355304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:18.456025 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.455988    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:18.556097 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.556009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:18.577489 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.577459    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:50:18.579424 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.579406    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:50:18.621716 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.621672    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfl5z\" (UniqueName: \"kubernetes.io/projected/7f62f00f-1a50-477b-bf7a-83bc167f8f20-kube-api-access-pfl5z\") pod \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") "
Sep 11 21:50:18.621908 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.621746    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/890d12a6-14a9-4a9c-975c-b769fce05fc1-plugins-config-volume\") pod \"890d12a6-14a9-4a9c-975c-b769fce05fc1\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") "
Sep 11 21:50:18.621908 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.621839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ghqp\" (UniqueName: \"kubernetes.io/projected/890d12a6-14a9-4a9c-975c-b769fce05fc1-kube-api-access-4ghqp\") pod \"890d12a6-14a9-4a9c-975c-b769fce05fc1\" (UID: \"890d12a6-14a9-4a9c-975c-b769fce05fc1\") "
Sep 11 21:50:18.621908 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.621889    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f62f00f-1a50-477b-bf7a-83bc167f8f20-plugins-config-volume\") pod \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\" (UID: \"7f62f00f-1a50-477b-bf7a-83bc167f8f20\") "
Sep 11 21:50:18.624380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.623431    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f62f00f-1a50-477b-bf7a-83bc167f8f20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f62f00f-1a50-477b-bf7a-83bc167f8f20" (UID: "7f62f00f-1a50-477b-bf7a-83bc167f8f20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:18.632310 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.626291    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f62f00f-1a50-477b-bf7a-83bc167f8f20-kube-api-access-pfl5z" (OuterVolumeSpecName: "kube-api-access-pfl5z") pod "7f62f00f-1a50-477b-bf7a-83bc167f8f20" (UID: "7f62f00f-1a50-477b-bf7a-83bc167f8f20"). InnerVolumeSpecName "kube-api-access-pfl5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:18.634164 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.633593    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/890d12a6-14a9-4a9c-975c-b769fce05fc1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "890d12a6-14a9-4a9c-975c-b769fce05fc1" (UID: "890d12a6-14a9-4a9c-975c-b769fce05fc1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:50:18.635774 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.635605    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/890d12a6-14a9-4a9c-975c-b769fce05fc1-kube-api-access-4ghqp" (OuterVolumeSpecName: "kube-api-access-4ghqp") pod "890d12a6-14a9-4a9c-975c-b769fce05fc1" (UID: "890d12a6-14a9-4a9c-975c-b769fce05fc1"). InnerVolumeSpecName "kube-api-access-4ghqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:18.724186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.724146    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfl5z\" (UniqueName: \"kubernetes.io/projected/7f62f00f-1a50-477b-bf7a-83bc167f8f20-kube-api-access-pfl5z\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:18.724186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.724181    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/890d12a6-14a9-4a9c-975c-b769fce05fc1-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:18.724186 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.724192    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ghqp\" (UniqueName: \"kubernetes.io/projected/890d12a6-14a9-4a9c-975c-b769fce05fc1-kube-api-access-4ghqp\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:18.724464 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.724201    2572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f62f00f-1a50-477b-bf7a-83bc167f8f20-plugins-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:18.839849 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.839727    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:18.941170 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:18.941134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:19.112799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.112699    2572 generic.go:356] "Generic (PLEG): container finished" podID="890d12a6-14a9-4a9c-975c-b769fce05fc1" containerID="3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1" exitCode=0
Sep 11 21:50:19.112799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.112763    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"
Sep 11 21:50:19.112799 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.112783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl" event={"ID":"890d12a6-14a9-4a9c-975c-b769fce05fc1","Type":"ContainerDied","Data":"3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1"}
Sep 11 21:50:19.113082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.112866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl" event={"ID":"890d12a6-14a9-4a9c-975c-b769fce05fc1","Type":"ContainerDied","Data":"ba3fa6ba6a210304644431f77f45ddf94490079e70d48d7525c7d0e8831cbbb3"}
Sep 11 21:50:19.113082 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.112892    2572 scope.go:117] "RemoveContainer" containerID="3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1"
Sep 11 21:50:19.114521 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.114498    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f62f00f-1a50-477b-bf7a-83bc167f8f20" containerID="8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33" exitCode=0
Sep 11 21:50:19.114644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.114557    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"
Sep 11 21:50:19.114644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.114577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw" event={"ID":"7f62f00f-1a50-477b-bf7a-83bc167f8f20","Type":"ContainerDied","Data":"8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33"}
Sep 11 21:50:19.114644 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.114613    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw" event={"ID":"7f62f00f-1a50-477b-bf7a-83bc167f8f20","Type":"ContainerDied","Data":"9c7ee33ba16766eba78a3e3cd9a07722342d1eb5aba82b40883a2e35155a0f7e"}
Sep 11 21:50:19.122893 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.122874    2572 scope.go:117] "RemoveContainer" containerID="3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1"
Sep 11 21:50:19.123180 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:50:19.123153    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1\": container with ID starting with 3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1 not found: ID does not exist" containerID="3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1"
Sep 11 21:50:19.123236 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.123191    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1"} err="failed to get container status \"3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1\": rpc error: code = NotFound desc = could not find container \"3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1\": container with ID starting with 3d488e82c1684d39f2a9b9216fe34073f43e0ec5842bf55872b82fdcec9b0ab1 not found: ID does not exist"
Sep 11 21:50:19.123236 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.123218    2572 scope.go:117] "RemoveContainer" containerID="8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33"
Sep 11 21:50:19.132957 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.132936    2572 scope.go:117] "RemoveContainer" containerID="8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33"
Sep 11 21:50:19.133241 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:50:19.133221    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33\": container with ID starting with 8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33 not found: ID does not exist" containerID="8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33"
Sep 11 21:50:19.133335 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.133266    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33"} err="failed to get container status \"8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33\": rpc error: code = NotFound desc = could not find container \"8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33\": container with ID starting with 8e57ab295e71e3fc41c9433562d1ef0894297166f4fb87f1871b77bdd12e5f33 not found: ID does not exist"
Sep 11 21:50:19.141459 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.141433    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"]
Sep 11 21:50:19.152155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.152126    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e0c211-6755598666-25bnl"]
Sep 11 21:50:19.163238 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.163203    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"]
Sep 11 21:50:19.167184 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:19.167160    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e0c211-bdd8cfbfc-p27jw"]
Sep 11 21:50:20.143098 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:20.143062    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f62f00f-1a50-477b-bf7a-83bc167f8f20" path="/var/lib/kubelet/pods/7f62f00f-1a50-477b-bf7a-83bc167f8f20/volumes"
Sep 11 21:50:20.143638 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:20.143615    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="890d12a6-14a9-4a9c-975c-b769fce05fc1" path="/var/lib/kubelet/pods/890d12a6-14a9-4a9c-975c-b769fce05fc1/volumes"
Sep 11 21:50:24.930861 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:24.930828    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:25.031291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:25.031234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:25.227505 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:25.227414    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:27.666732 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:27.666693    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-5nnsf"]
Sep 11 21:50:27.667188 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:27.666929    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf" podUID="5b632455-f0a6-434a-ab24-ed2a12c2c0ea" containerName="manager" containerID="cri-o://cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa" gracePeriod=30
Sep 11 21:50:27.915502 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:27.915474    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:50:28.007934 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.007906    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-webhook-cert\") pod \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") "
Sep 11 21:50:28.008077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.007956    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn6rw\" (UniqueName: \"kubernetes.io/projected/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-kube-api-access-kn6rw\") pod \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") "
Sep 11 21:50:28.008077 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.008023    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs\") pod \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\" (UID: \"5b632455-f0a6-434a-ab24-ed2a12c2c0ea\") "
Sep 11 21:50:28.010002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.009967    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-kube-api-access-kn6rw" (OuterVolumeSpecName: "kube-api-access-kn6rw") pod "5b632455-f0a6-434a-ab24-ed2a12c2c0ea" (UID: "5b632455-f0a6-434a-ab24-ed2a12c2c0ea"). InnerVolumeSpecName "kube-api-access-kn6rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:28.010002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.009979    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5b632455-f0a6-434a-ab24-ed2a12c2c0ea" (UID: "5b632455-f0a6-434a-ab24-ed2a12c2c0ea"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:50:28.010160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.010001    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5b632455-f0a6-434a-ab24-ed2a12c2c0ea" (UID: "5b632455-f0a6-434a-ab24-ed2a12c2c0ea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:50:28.109379 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.109339    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:28.109379 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.109370    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-webhook-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:28.109379 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.109379    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn6rw\" (UniqueName: \"kubernetes.io/projected/5b632455-f0a6-434a-ab24-ed2a12c2c0ea-kube-api-access-kn6rw\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:50:28.172764 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.172729    2572 generic.go:356] "Generic (PLEG): container finished" podID="5b632455-f0a6-434a-ab24-ed2a12c2c0ea" containerID="cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa" exitCode=0
Sep 11 21:50:28.172915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.172776    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf"
Sep 11 21:50:28.172915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.172786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf" event={"ID":"5b632455-f0a6-434a-ab24-ed2a12c2c0ea","Type":"ContainerDied","Data":"cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa"}
Sep 11 21:50:28.172915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.172835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-5nnsf" event={"ID":"5b632455-f0a6-434a-ab24-ed2a12c2c0ea","Type":"ContainerDied","Data":"920933e71c223c9f14dd3acaf13eab75c4cbf79088a7de181d74345a97919fb5"}
Sep 11 21:50:28.172915 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.172864    2572 scope.go:117] "RemoveContainer" containerID="cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa"
Sep 11 21:50:28.182711 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.182692    2572 scope.go:117] "RemoveContainer" containerID="cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa"
Sep 11 21:50:28.182960 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:50:28.182939    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa\": container with ID starting with cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa not found: ID does not exist" containerID="cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa"
Sep 11 21:50:28.183018 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.182967    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa"} err="failed to get container status \"cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa\": rpc error: code = NotFound desc = could not find container \"cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa\": container with ID starting with cefc590cee173122b1d4db6fcd5b22d506144d5c53f5b25c5ebc84fd78d797aa not found: ID does not exist"
Sep 11 21:50:28.190765 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.190731    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-5nnsf"]
Sep 11 21:50:28.194076 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:28.194055    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-5nnsf"]
Sep 11 21:50:30.143591 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:30.143553    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b632455-f0a6-434a-ab24-ed2a12c2c0ea" path="/var/lib/kubelet/pods/5b632455-f0a6-434a-ab24-ed2a12c2c0ea/volumes"
Sep 11 21:50:38.419584 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:38.419550    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:50:55.348131 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:50:55.348097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:51:28.977550 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977507    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-mtcd9"]
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977947    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" containerName="payload-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977958    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" containerName="payload-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977969    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2a155f-3c2c-4798-8735-e1fea010955c" containerName="payload-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977974    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2a155f-3c2c-4798-8735-e1fea010955c" containerName="payload-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977983    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="890d12a6-14a9-4a9c-975c-b769fce05fc1" containerName="payload-pre-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977989    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="890d12a6-14a9-4a9c-975c-b769fce05fc1" containerName="payload-pre-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.977996    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f62f00f-1a50-477b-bf7a-83bc167f8f20" containerName="payload-processing"
Sep 11 21:51:28.978006 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978001    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f62f00f-1a50-477b-bf7a-83bc167f8f20" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978017    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2124cd-606a-4bed-b736-4935678deebe" containerName="maas-api"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978022    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2124cd-606a-4bed-b736-4935678deebe" containerName="maas-api"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978030    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852f0217-cdba-45b0-9b39-23dc0e0bef77" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978036    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="852f0217-cdba-45b0-9b39-23dc0e0bef77" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978044    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b632455-f0a6-434a-ab24-ed2a12c2c0ea" containerName="manager"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978049    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b632455-f0a6-434a-ab24-ed2a12c2c0ea" containerName="manager"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978111    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2124cd-606a-4bed-b736-4935678deebe" containerName="maas-api"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978120    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="852f0217-cdba-45b0-9b39-23dc0e0bef77" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978127    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e3bdc3-be8c-47e0-8c5e-dc1719c1ef74" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978134    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2a155f-3c2c-4798-8735-e1fea010955c" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978139    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f62f00f-1a50-477b-bf7a-83bc167f8f20" containerName="payload-processing"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978145    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b632455-f0a6-434a-ab24-ed2a12c2c0ea" containerName="manager"
Sep 11 21:51:28.978291 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.978151    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="890d12a6-14a9-4a9c-975c-b769fce05fc1" containerName="payload-pre-processing"
Sep 11 21:51:28.981135 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.981119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:28.984871 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.984838    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:51:28.985020 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.984844    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:51:28.985020 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.984900    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5zwvz\""
Sep 11 21:51:28.985020 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.984935    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:51:28.991966 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:28.991942    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-mtcd9"]
Sep 11 21:51:29.073101 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.073066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgml6\" (UniqueName: \"kubernetes.io/projected/49b10ee2-1425-4915-b4da-4891ec8e3c1f-kube-api-access-pgml6\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.073300 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.073148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-metrics-certs\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.073300 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.073284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-webhook-cert\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.174520 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.174476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-webhook-cert\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.174714 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.174534    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgml6\" (UniqueName: \"kubernetes.io/projected/49b10ee2-1425-4915-b4da-4891ec8e3c1f-kube-api-access-pgml6\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.174714 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.174576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-metrics-certs\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.176883 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.176857    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-webhook-cert\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.177002 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.176944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-metrics-certs\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.183528 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.183505    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgml6\" (UniqueName: \"kubernetes.io/projected/49b10ee2-1425-4915-b4da-4891ec8e3c1f-kube-api-access-pgml6\") pod \"maas-controller-6b7dbdfb66-mtcd9\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") " pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.292573 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.292543    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:29.565096 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.565071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-mtcd9"]
Sep 11 21:51:29.566618 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:51:29.566594    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b10ee2_1425_4915_b4da_4891ec8e3c1f.slice/crio-37570d66e2f22270e4a953b7b7f8be92fb64f97855acd2aa5bdbb806a71c6bc7 WatchSource:0}: Error finding container 37570d66e2f22270e4a953b7b7f8be92fb64f97855acd2aa5bdbb806a71c6bc7: Status 404 returned error can't find the container with id 37570d66e2f22270e4a953b7b7f8be92fb64f97855acd2aa5bdbb806a71c6bc7
Sep 11 21:51:29.568066 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:29.568048    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:51:30.527573 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:30.527534    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9" event={"ID":"49b10ee2-1425-4915-b4da-4891ec8e3c1f","Type":"ContainerStarted","Data":"3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c"}
Sep 11 21:51:30.527958 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:30.527591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9" event={"ID":"49b10ee2-1425-4915-b4da-4891ec8e3c1f","Type":"ContainerStarted","Data":"37570d66e2f22270e4a953b7b7f8be92fb64f97855acd2aa5bdbb806a71c6bc7"}
Sep 11 21:51:30.527958 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:30.527614    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:30.547745 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:30.547698    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9" podStartSLOduration=1.784825742 podStartE2EDuration="2.547683415s" totalImagesPullingTime="762.857673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:51:30.544962604 +0000 UTC m=+2052.857187970" watchObservedRunningTime="2026-09-11 21:51:30.547683415 +0000 UTC m=+2052.859908782"
Sep 11 21:51:41.536784 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:41.536712    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:50.760457 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:50.760423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:51:50.858603 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:50.858566    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-mtcd9"]
Sep 11 21:51:50.858832 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:50.858808    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9" podUID="49b10ee2-1425-4915-b4da-4891ec8e3c1f" containerName="manager" containerID="cri-o://3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c" gracePeriod=30
Sep 11 21:51:51.107011 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.106989    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:51.175505 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.175474    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgml6\" (UniqueName: \"kubernetes.io/projected/49b10ee2-1425-4915-b4da-4891ec8e3c1f-kube-api-access-pgml6\") pod \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") "
Sep 11 21:51:51.175505 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.175512    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-webhook-cert\") pod \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") "
Sep 11 21:51:51.175691 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.175564    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-metrics-certs\") pod \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\" (UID: \"49b10ee2-1425-4915-b4da-4891ec8e3c1f\") "
Sep 11 21:51:51.177673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.177618    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b10ee2-1425-4915-b4da-4891ec8e3c1f-kube-api-access-pgml6" (OuterVolumeSpecName: "kube-api-access-pgml6") pod "49b10ee2-1425-4915-b4da-4891ec8e3c1f" (UID: "49b10ee2-1425-4915-b4da-4891ec8e3c1f"). InnerVolumeSpecName "kube-api-access-pgml6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:51:51.177673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.177633    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "49b10ee2-1425-4915-b4da-4891ec8e3c1f" (UID: "49b10ee2-1425-4915-b4da-4891ec8e3c1f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:51:51.177847 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.177684    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "49b10ee2-1425-4915-b4da-4891ec8e3c1f" (UID: "49b10ee2-1425-4915-b4da-4891ec8e3c1f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:51:51.276702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.276616    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgml6\" (UniqueName: \"kubernetes.io/projected/49b10ee2-1425-4915-b4da-4891ec8e3c1f-kube-api-access-pgml6\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:51:51.276702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.276647    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-webhook-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:51:51.276702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.276658    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49b10ee2-1425-4915-b4da-4891ec8e3c1f-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:51:51.650374 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.650285    2572 generic.go:356] "Generic (PLEG): container finished" podID="49b10ee2-1425-4915-b4da-4891ec8e3c1f" containerID="3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c" exitCode=0
Sep 11 21:51:51.650374 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.650324    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9" event={"ID":"49b10ee2-1425-4915-b4da-4891ec8e3c1f","Type":"ContainerDied","Data":"3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c"}
Sep 11 21:51:51.650374 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.650373    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9" event={"ID":"49b10ee2-1425-4915-b4da-4891ec8e3c1f","Type":"ContainerDied","Data":"37570d66e2f22270e4a953b7b7f8be92fb64f97855acd2aa5bdbb806a71c6bc7"}
Sep 11 21:51:51.650621 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.650404    2572 scope.go:117] "RemoveContainer" containerID="3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c"
Sep 11 21:51:51.650621 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.650328    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-mtcd9"
Sep 11 21:51:51.660076 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.660056    2572 scope.go:117] "RemoveContainer" containerID="3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c"
Sep 11 21:51:51.660356 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:51:51.660335    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c\": container with ID starting with 3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c not found: ID does not exist" containerID="3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c"
Sep 11 21:51:51.660431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.660364    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c"} err="failed to get container status \"3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c\": rpc error: code = NotFound desc = could not find container \"3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c\": container with ID starting with 3ede6fe91bec8272865548f99d60cb996dac2305ba923a6c1220342c4401414c not found: ID does not exist"
Sep 11 21:51:51.672432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.672407    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-mtcd9"]
Sep 11 21:51:51.674710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:51.674689    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-mtcd9"]
Sep 11 21:51:52.144097 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.144064    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49b10ee2-1425-4915-b4da-4891ec8e3c1f" path="/var/lib/kubelet/pods/49b10ee2-1425-4915-b4da-4891ec8e3c1f/volumes"
Sep 11 21:51:52.396810 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.396719    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:51:52.530244 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.530198    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-8npq5"]
Sep 11 21:51:52.530640 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.530627    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b10ee2-1425-4915-b4da-4891ec8e3c1f" containerName="manager"
Sep 11 21:51:52.530685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.530641    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b10ee2-1425-4915-b4da-4891ec8e3c1f" containerName="manager"
Sep 11 21:51:52.530721 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.530711    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b10ee2-1425-4915-b4da-4891ec8e3c1f" containerName="manager"
Sep 11 21:51:52.533853 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.533835    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.539479 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.539458    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5zwvz\""
Sep 11 21:51:52.539927 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.539907    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:51:52.540030 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.539911    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:51:52.540481 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.540448    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:51:52.558098 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.558075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-8npq5"]
Sep 11 21:51:52.589596 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.589561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8eddc7b-4882-4cec-a611-1c6747d545ca-webhook-cert\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.589779 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.589700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr46w\" (UniqueName: \"kubernetes.io/projected/b8eddc7b-4882-4cec-a611-1c6747d545ca-kube-api-access-gr46w\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.589779 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.589749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8eddc7b-4882-4cec-a611-1c6747d545ca-metrics-certs\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.690564 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.690488    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr46w\" (UniqueName: \"kubernetes.io/projected/b8eddc7b-4882-4cec-a611-1c6747d545ca-kube-api-access-gr46w\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.690564 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.690530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8eddc7b-4882-4cec-a611-1c6747d545ca-metrics-certs\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.690782 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.690602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8eddc7b-4882-4cec-a611-1c6747d545ca-webhook-cert\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.692897 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.692871    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8eddc7b-4882-4cec-a611-1c6747d545ca-webhook-cert\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.692995 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.692913    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8eddc7b-4882-4cec-a611-1c6747d545ca-metrics-certs\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.698557 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.698532    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr46w\" (UniqueName: \"kubernetes.io/projected/b8eddc7b-4882-4cec-a611-1c6747d545ca-kube-api-access-gr46w\") pod \"maas-controller-6b7dbdfb66-8npq5\" (UID: \"b8eddc7b-4882-4cec-a611-1c6747d545ca\") " pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:52.844071 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:52.844027    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:53.117706 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:53.117670    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7dbdfb66-8npq5"]
Sep 11 21:51:53.118473 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:51:53.118435    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8eddc7b_4882_4cec_a611_1c6747d545ca.slice/crio-0c88cfc1c04216a72196b0cccf400b318fd4f82c3fc511f2888c66462e0e3402 WatchSource:0}: Error finding container 0c88cfc1c04216a72196b0cccf400b318fd4f82c3fc511f2888c66462e0e3402: Status 404 returned error can't find the container with id 0c88cfc1c04216a72196b0cccf400b318fd4f82c3fc511f2888c66462e0e3402
Sep 11 21:51:53.664865 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:53.664827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5" event={"ID":"b8eddc7b-4882-4cec-a611-1c6747d545ca","Type":"ContainerStarted","Data":"eeb48d724c3de8eb591188fe320d6d948f90ebd17d28f04f4c359f1b53b5a3db"}
Sep 11 21:51:53.665368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:53.664889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5" event={"ID":"b8eddc7b-4882-4cec-a611-1c6747d545ca","Type":"ContainerStarted","Data":"0c88cfc1c04216a72196b0cccf400b318fd4f82c3fc511f2888c66462e0e3402"}
Sep 11 21:51:53.665368 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:53.664935    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:51:53.682384 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:51:53.682331    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5" podStartSLOduration=1.302439143 podStartE2EDuration="1.682314006s" totalImagesPullingTime="379.874863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:51:53.680615769 +0000 UTC m=+2075.992841136" watchObservedRunningTime="2026-09-11 21:51:53.682314006 +0000 UTC m=+2075.994539373"
Sep 11 21:52:04.672702 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:52:04.672671    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b7dbdfb66-8npq5"
Sep 11 21:52:18.356022 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:52:18.355984    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:52:18.365918 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:52:18.365895    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:53:01.178367 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:53:01.178328    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:54:33.856432 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:54:33.856383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:54:36.882838 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:54:36.882805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:54:57.552568 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:54:57.552535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:54:58.888513 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:54:58.888484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:55:14.583672 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:14.583635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:55:22.716512 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.716477    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"]
Sep 11 21:55:22.720137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.720121    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.729807 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.729756    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"]
Sep 11 21:55:22.745309 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.745280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42862d59-8e0d-495b-a3d7-d01681221d5c-metrics-certs\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.745452 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.745344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfbgz\" (UniqueName: \"kubernetes.io/projected/42862d59-8e0d-495b-a3d7-d01681221d5c-kube-api-access-mfbgz\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.745452 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.745390    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42862d59-8e0d-495b-a3d7-d01681221d5c-maas-api-tls\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.745452 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.745407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42862d59-8e0d-495b-a3d7-d01681221d5c-openshift-service-ca\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.846862 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.846819    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42862d59-8e0d-495b-a3d7-d01681221d5c-metrics-certs\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.847055 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.846888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfbgz\" (UniqueName: \"kubernetes.io/projected/42862d59-8e0d-495b-a3d7-d01681221d5c-kube-api-access-mfbgz\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.847055 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.846937    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42862d59-8e0d-495b-a3d7-d01681221d5c-maas-api-tls\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.847055 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.846959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42862d59-8e0d-495b-a3d7-d01681221d5c-openshift-service-ca\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.847679 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.847653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42862d59-8e0d-495b-a3d7-d01681221d5c-openshift-service-ca\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.849382 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.849356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42862d59-8e0d-495b-a3d7-d01681221d5c-metrics-certs\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.849470 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.849366    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42862d59-8e0d-495b-a3d7-d01681221d5c-maas-api-tls\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:22.854901 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:22.854879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfbgz\" (UniqueName: \"kubernetes.io/projected/42862d59-8e0d-495b-a3d7-d01681221d5c-kube-api-access-mfbgz\") pod \"maas-api-786f4dddd4-9l99q\" (UID: \"42862d59-8e0d-495b-a3d7-d01681221d5c\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:23.031848 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:23.031805    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:23.309045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:23.309021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"]
Sep 11 21:55:23.310602 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:55:23.310573    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42862d59_8e0d_495b_a3d7_d01681221d5c.slice/crio-5bd2145f867f1b2e788f8348dcd1e42a0d313530819a324575f9a0938f93221d WatchSource:0}: Error finding container 5bd2145f867f1b2e788f8348dcd1e42a0d313530819a324575f9a0938f93221d: Status 404 returned error can't find the container with id 5bd2145f867f1b2e788f8348dcd1e42a0d313530819a324575f9a0938f93221d
Sep 11 21:55:23.880507 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:23.880465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q" event={"ID":"42862d59-8e0d-495b-a3d7-d01681221d5c","Type":"ContainerStarted","Data":"7fb5541898d98434454e2fe291ee735e70ddd31ea9cf8ade0b5e6d603af4ae2e"}
Sep 11 21:55:23.880860 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:23.880524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q" event={"ID":"42862d59-8e0d-495b-a3d7-d01681221d5c","Type":"ContainerStarted","Data":"5bd2145f867f1b2e788f8348dcd1e42a0d313530819a324575f9a0938f93221d"}
Sep 11 21:55:23.880860 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:23.880551    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:23.897504 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:23.897423    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q" podStartSLOduration=1.5685679270000001 podStartE2EDuration="1.89740618s" totalImagesPullingTime="328.838253ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:55:23.896373037 +0000 UTC m=+2286.208598403" watchObservedRunningTime="2026-09-11 21:55:23.89740618 +0000 UTC m=+2286.209631570"
Sep 11 21:55:29.891869 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:29.891835    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-9l99q"
Sep 11 21:55:29.937541 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:29.937500    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"]
Sep 11 21:55:29.937768 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:29.937744    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv" podUID="077f93ee-8a3f-457e-bad4-504611f5a9ba" containerName="maas-api" containerID="cri-o://f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac" gracePeriod=30
Sep 11 21:55:31.186787 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.186764    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:55:31.225365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.225336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-metrics-certs\") pod \"077f93ee-8a3f-457e-bad4-504611f5a9ba\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") "
Sep 11 21:55:31.225575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.225383    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqhrk\" (UniqueName: \"kubernetes.io/projected/077f93ee-8a3f-457e-bad4-504611f5a9ba-kube-api-access-tqhrk\") pod \"077f93ee-8a3f-457e-bad4-504611f5a9ba\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") "
Sep 11 21:55:31.225575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.225415    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-maas-api-tls\") pod \"077f93ee-8a3f-457e-bad4-504611f5a9ba\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") "
Sep 11 21:55:31.225575 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.225446    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077f93ee-8a3f-457e-bad4-504611f5a9ba-openshift-service-ca\") pod \"077f93ee-8a3f-457e-bad4-504611f5a9ba\" (UID: \"077f93ee-8a3f-457e-bad4-504611f5a9ba\") "
Sep 11 21:55:31.225875 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.225842    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/077f93ee-8a3f-457e-bad4-504611f5a9ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "077f93ee-8a3f-457e-bad4-504611f5a9ba" (UID: "077f93ee-8a3f-457e-bad4-504611f5a9ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:55:31.227662 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.227640    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "077f93ee-8a3f-457e-bad4-504611f5a9ba" (UID: "077f93ee-8a3f-457e-bad4-504611f5a9ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:55:31.227752 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.227650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/077f93ee-8a3f-457e-bad4-504611f5a9ba-kube-api-access-tqhrk" (OuterVolumeSpecName: "kube-api-access-tqhrk") pod "077f93ee-8a3f-457e-bad4-504611f5a9ba" (UID: "077f93ee-8a3f-457e-bad4-504611f5a9ba"). InnerVolumeSpecName "kube-api-access-tqhrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:55:31.227945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.227916    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "077f93ee-8a3f-457e-bad4-504611f5a9ba" (UID: "077f93ee-8a3f-457e-bad4-504611f5a9ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:55:31.327363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.327280    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqhrk\" (UniqueName: \"kubernetes.io/projected/077f93ee-8a3f-457e-bad4-504611f5a9ba-kube-api-access-tqhrk\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:55:31.327363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.327306    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-maas-api-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:55:31.327363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.327315    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077f93ee-8a3f-457e-bad4-504611f5a9ba-openshift-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:55:31.327363 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.327323    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077f93ee-8a3f-457e-bad4-504611f5a9ba-metrics-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\""
Sep 11 21:55:31.925545 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.925507    2572 generic.go:356] "Generic (PLEG): container finished" podID="077f93ee-8a3f-457e-bad4-504611f5a9ba" containerID="f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac" exitCode=0
Sep 11 21:55:31.925725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.925561    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"
Sep 11 21:55:31.925725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.925601    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv" event={"ID":"077f93ee-8a3f-457e-bad4-504611f5a9ba","Type":"ContainerDied","Data":"f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac"}
Sep 11 21:55:31.925725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.925650    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv" event={"ID":"077f93ee-8a3f-457e-bad4-504611f5a9ba","Type":"ContainerDied","Data":"5b8360a86739f9b06669e264d31691f886a9fb2ea782347e1cbae46832ac0609"}
Sep 11 21:55:31.925725 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.925672    2572 scope.go:117] "RemoveContainer" containerID="f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac"
Sep 11 21:55:31.936013 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.935994    2572 scope.go:117] "RemoveContainer" containerID="f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac"
Sep 11 21:55:31.936292 ip-10-0-136-69 kubenswrapper[2572]: E0911 21:55:31.936275    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac\": container with ID starting with f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac not found: ID does not exist" containerID="f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac"
Sep 11 21:55:31.936365 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.936300    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac"} err="failed to get container status \"f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac\": rpc error: code = NotFound desc = could not find container \"f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac\": container with ID starting with f0e67fee3fa305506662d8e5a846b3b6baa6675c9ad0420651596c5c00e333ac not found: ID does not exist"
Sep 11 21:55:31.947829 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.947804    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"]
Sep 11 21:55:31.951569 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:31.951547    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-nllnv"]
Sep 11 21:55:32.144056 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:32.144025    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="077f93ee-8a3f-457e-bad4-504611f5a9ba" path="/var/lib/kubelet/pods/077f93ee-8a3f-457e-bad4-504611f5a9ba/volumes"
Sep 11 21:55:40.166109 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:40.166072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:55:50.234613 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:50.234578    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b7dbdfb66-8npq5_b8eddc7b-4882-4cec-a611-1c6747d545ca/manager/0.log"
Sep 11 21:55:50.614137 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:50.614109    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-bjkrh_bbc67a51-9d3b-4f29-badd-a9b6f6c259f9/copy-manifests/0.log"
Sep 11 21:55:50.621431 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:50.621403    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-bjkrh_bbc67a51-9d3b-4f29-badd-a9b6f6c259f9/manager/0.log"
Sep 11 21:55:51.205115 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:51.205085    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-786f4dddd4-9l99q_42862d59-8e0d-495b-a3d7-d01681221d5c/maas-api/0.log"
Sep 11 21:55:51.535171 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:51.535147    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819385-mttdr_4dac78d5-d30e-4a44-a456-3681b55f0d65/cleanup/0.log"
Sep 11 21:55:51.648535 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:51.648504    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5t27p_4cb067e3-5b4b-4ca2-916c-1fd6d349c274/postgres/0.log"
Sep 11 21:55:52.806757 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:52.806731    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-kvq2b_059177a9-7327-49c9-943e-ac4b6548bc13/kuadrant-console-plugin/0.log"
Sep 11 21:55:53.967739 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:53.967703    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5564d7bb97-sg8nb_86a54eda-3b78-40eb-8d84-c63e268f9ea2/kube-auth-proxy/0.log"
Sep 11 21:55:54.212818 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:54.212781    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-m785w_59b05160-f986-4e91-a63b-804edaabca66/payload-pre-processing/0.log"
Sep 11 21:55:54.923428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:54.923394    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2pbnx_cafd7637-47b1-4e6f-8d84-2708734d5c24/main/0.log"
Sep 11 21:55:55.038870 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:55:55.038834    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-mthx6_028d1807-9156-450c-baf7-b9f3b70ba67f/main/0.log"
Sep 11 21:56:00.586046 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.586006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:56:00.586850 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.586826    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xhtjn/must-gather-mxbjd"]
Sep 11 21:56:00.587337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.587323    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077f93ee-8a3f-457e-bad4-504611f5a9ba" containerName="maas-api"
Sep 11 21:56:00.587337 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.587338    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="077f93ee-8a3f-457e-bad4-504611f5a9ba" containerName="maas-api"
Sep 11 21:56:00.587465 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.587409    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="077f93ee-8a3f-457e-bad4-504611f5a9ba" containerName="maas-api"
Sep 11 21:56:00.590625 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.590609    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.593147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.593127    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhtjn\"/\"openshift-service-ca.crt\""
Sep 11 21:56:00.593278 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.593258    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xhtjn\"/\"kube-root-ca.crt\""
Sep 11 21:56:00.593333 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.593305    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xhtjn\"/\"default-dockercfg-8csvh\""
Sep 11 21:56:00.599428 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.599408    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhtjn/must-gather-mxbjd"]
Sep 11 21:56:00.607045 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.607018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/25c18687-a6b4-40c0-9f1d-3def83317f55-must-gather-output\") pod \"must-gather-mxbjd\" (UID: \"25c18687-a6b4-40c0-9f1d-3def83317f55\") " pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.607155 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.607077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2sp6\" (UniqueName: \"kubernetes.io/projected/25c18687-a6b4-40c0-9f1d-3def83317f55-kube-api-access-l2sp6\") pod \"must-gather-mxbjd\" (UID: \"25c18687-a6b4-40c0-9f1d-3def83317f55\") " pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.661834 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.661801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log" limit=1024
Sep 11 21:56:00.707937 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.707904    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2sp6\" (UniqueName: \"kubernetes.io/projected/25c18687-a6b4-40c0-9f1d-3def83317f55-kube-api-access-l2sp6\") pod \"must-gather-mxbjd\" (UID: \"25c18687-a6b4-40c0-9f1d-3def83317f55\") " pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.708125 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.707996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/25c18687-a6b4-40c0-9f1d-3def83317f55-must-gather-output\") pod \"must-gather-mxbjd\" (UID: \"25c18687-a6b4-40c0-9f1d-3def83317f55\") " pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.708349 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.708331    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/25c18687-a6b4-40c0-9f1d-3def83317f55-must-gather-output\") pod \"must-gather-mxbjd\" (UID: \"25c18687-a6b4-40c0-9f1d-3def83317f55\") " pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.717544 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.717517    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2sp6\" (UniqueName: \"kubernetes.io/projected/25c18687-a6b4-40c0-9f1d-3def83317f55-kube-api-access-l2sp6\") pod \"must-gather-mxbjd\" (UID: \"25c18687-a6b4-40c0-9f1d-3def83317f55\") " pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:00.900729 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:00.900640    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhtjn/must-gather-mxbjd"
Sep 11 21:56:01.188580 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:01.188551    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhtjn/must-gather-mxbjd"]
Sep 11 21:56:01.189924 ip-10-0-136-69 kubenswrapper[2572]: W0911 21:56:01.189888    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25c18687_a6b4_40c0_9f1d_3def83317f55.slice/crio-d8bdb39cbc293fd8adac779b60af5c520d1b990edd914ca9de741a496ae1121d WatchSource:0}: Error finding container d8bdb39cbc293fd8adac779b60af5c520d1b990edd914ca9de741a496ae1121d: Status 404 returned error can't find the container with id d8bdb39cbc293fd8adac779b60af5c520d1b990edd914ca9de741a496ae1121d
Sep 11 21:56:02.105788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:02.105695    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/must-gather-mxbjd" event={"ID":"25c18687-a6b4-40c0-9f1d-3def83317f55","Type":"ContainerStarted","Data":"e862ca62e25705d36386efac816800e0863282a4e4e27440365374ca8eb746c9"}
Sep 11 21:56:02.105788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:02.105752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/must-gather-mxbjd" event={"ID":"25c18687-a6b4-40c0-9f1d-3def83317f55","Type":"ContainerStarted","Data":"d8bdb39cbc293fd8adac779b60af5c520d1b990edd914ca9de741a496ae1121d"}
Sep 11 21:56:03.116884 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:03.116839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/must-gather-mxbjd" event={"ID":"25c18687-a6b4-40c0-9f1d-3def83317f55","Type":"ContainerStarted","Data":"07d14db26d729f04ad1d0f76bce590dee5dfe5c4e4fa2ac9ddfa138655279204"}
Sep 11 21:56:03.591945 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:03.591898    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kml8k_4cf12b1b-2278-4c3f-907d-2126b4406c47/global-pull-secret-syncer/0.log"
Sep 11 21:56:03.725125 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:03.725091    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9g98q_36603f6d-7093-4b76-811f-0ba3b99cf1a1/konnectivity-agent/0.log"
Sep 11 21:56:03.850061 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:03.849964    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-69.ec2.internal_c24e9ba836f4240933944f4d8c43e5f4/haproxy/0.log"
Sep 11 21:56:09.144874 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:09.144843    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-kvq2b_059177a9-7327-49c9-943e-ac4b6548bc13/kuadrant-console-plugin/0.log"
Sep 11 21:56:10.821380 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.821316    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/alertmanager/0.log"
Sep 11 21:56:10.851534 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.851486    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/config-reloader/0.log"
Sep 11 21:56:10.874160 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.874127    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/kube-rbac-proxy-web/0.log"
Sep 11 21:56:10.904594 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.904546    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/kube-rbac-proxy/0.log"
Sep 11 21:56:10.932790 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.932762    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/kube-rbac-proxy-metric/0.log"
Sep 11 21:56:10.966753 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.966725    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/prom-label-proxy/0.log"
Sep 11 21:56:10.994181 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:10.994153    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_67b5574b-9e6f-40e6-9f7c-1a9932595e9d/init-config-reloader/0.log"
Sep 11 21:56:11.048423 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.048338    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-vrdhh_43e312cc-1d7f-4b91-a55f-789d40439b8b/cluster-monitoring-operator/0.log"
Sep 11 21:56:11.078693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.078653    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-t2lpg_7f06b564-3125-4d3f-b1d4-83977d090026/kube-state-metrics/0.log"
Sep 11 21:56:11.096959 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.096927    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-t2lpg_7f06b564-3125-4d3f-b1d4-83977d090026/kube-rbac-proxy-main/0.log"
Sep 11 21:56:11.120986 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.120947    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-t2lpg_7f06b564-3125-4d3f-b1d4-83977d090026/kube-rbac-proxy-self/0.log"
Sep 11 21:56:11.146410 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.146377    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5854956bc9-ntmj7_96a26303-b1e4-4ae3-978e-ee6263a3c8b0/metrics-server/0.log"
Sep 11 21:56:11.171628 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.171591    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-nwqwx_4a4fd46f-5b2a-4295-a123-d94141e44908/monitoring-plugin/0.log"
Sep 11 21:56:11.200955 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.200914    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcpx6_c86c7814-5e47-4cfd-a17d-cf2b77ab9df2/node-exporter/0.log"
Sep 11 21:56:11.220882 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.220844    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcpx6_c86c7814-5e47-4cfd-a17d-cf2b77ab9df2/kube-rbac-proxy/0.log"
Sep 11 21:56:11.242106 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.242078    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pcpx6_c86c7814-5e47-4cfd-a17d-cf2b77ab9df2/init-textfile/0.log"
Sep 11 21:56:11.412586 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.412482    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-g9qbj_0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d/kube-rbac-proxy-main/0.log"
Sep 11 21:56:11.432599 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.432553    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-g9qbj_0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d/kube-rbac-proxy-self/0.log"
Sep 11 21:56:11.454971 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.454936    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-g9qbj_0bd20998-5dd2-4dd4-8f6c-0c7dfb559f8d/openshift-state-metrics/0.log"
Sep 11 21:56:11.649808 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.649773    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-kfrhj_e7f833b0-78d0-49da-af5c-e6ccc7747e34/prometheus-operator/0.log"
Sep 11 21:56:11.668913 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.668813    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-kfrhj_e7f833b0-78d0-49da-af5c-e6ccc7747e34/kube-rbac-proxy/0.log"
Sep 11 21:56:11.692147 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.692120    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-f2tgw_a98bf6da-ef01-4637-a2d6-93c59421878b/prometheus-operator-admission-webhook/0.log"
Sep 11 21:56:11.733354 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.733303    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5896d849dc-kllvc_58536a91-52ca-47cd-9749-f18bb29325cc/telemeter-client/0.log"
Sep 11 21:56:11.755894 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.755837    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5896d849dc-kllvc_58536a91-52ca-47cd-9749-f18bb29325cc/reload/0.log"
Sep 11 21:56:11.778357 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.778334    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5896d849dc-kllvc_58536a91-52ca-47cd-9749-f18bb29325cc/kube-rbac-proxy/0.log"
Sep 11 21:56:11.811062 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.811018    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5b666656-ptqv2_4a092328-917d-4899-9980-879cfeebbce1/thanos-query/0.log"
Sep 11 21:56:11.831803 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.831774    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5b666656-ptqv2_4a092328-917d-4899-9980-879cfeebbce1/kube-rbac-proxy-web/0.log"
Sep 11 21:56:11.852132 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.852086    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5b666656-ptqv2_4a092328-917d-4899-9980-879cfeebbce1/kube-rbac-proxy/0.log"
Sep 11 21:56:11.875514 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.875486    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5b666656-ptqv2_4a092328-917d-4899-9980-879cfeebbce1/prom-label-proxy/0.log"
Sep 11 21:56:11.895904 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.895870    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5b666656-ptqv2_4a092328-917d-4899-9980-879cfeebbce1/kube-rbac-proxy-rules/0.log"
Sep 11 21:56:11.919685 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:11.919613    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b5b666656-ptqv2_4a092328-917d-4899-9980-879cfeebbce1/kube-rbac-proxy-metrics/0.log"
Sep 11 21:56:13.120458 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.120419    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-nv6bd_13b90bbb-e11d-42dd-98bd-22876c19a6d8/networking-console-plugin/0.log"
Sep 11 21:56:13.721828 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.721796    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/1.log"
Sep 11 21:56:13.728426 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.728402    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-kvb4l_44ec3e0b-ad2d-4cb5-8c6b-0269bf3a34e7/console-operator/2.log"
Sep 11 21:56:13.800043 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.799974    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xhtjn/must-gather-mxbjd" podStartSLOduration=13.052098195 podStartE2EDuration="13.799952192s" totalImagesPullingTime="747.853997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:56:03.133134675 +0000 UTC m=+2325.445360042" watchObservedRunningTime="2026-09-11 21:56:13.799952192 +0000 UTC m=+2336.112177562"
Sep 11 21:56:13.800438 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.800410    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"]
Sep 11 21:56:13.806693 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.806666    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.812414 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.812389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"]
Sep 11 21:56:13.863326 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.863280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-sys\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.863525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.863363    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-proc\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.863525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.863407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsll5\" (UniqueName: \"kubernetes.io/projected/400ec2ef-6843-43f8-b526-955b34f264f3-kube-api-access-wsll5\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.863525 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.863477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-podres\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.863710 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.863533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-lib-modules\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.964761 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.964713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-proc\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.964940 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.964785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsll5\" (UniqueName: \"kubernetes.io/projected/400ec2ef-6843-43f8-b526-955b34f264f3-kube-api-access-wsll5\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.964940 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.964829    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-proc\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.965166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.964934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-podres\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.965166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.964999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-lib-modules\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.965166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.965069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-sys\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.965166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.965117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-podres\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.965166 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.965160    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-sys\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.965477 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.965216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/400ec2ef-6843-43f8-b526-955b34f264f3-lib-modules\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:13.984715 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:13.976052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsll5\" (UniqueName: \"kubernetes.io/projected/400ec2ef-6843-43f8-b526-955b34f264f3-kube-api-access-wsll5\") pod \"perf-node-gather-daemonset-fd4vf\" (UID: \"400ec2ef-6843-43f8-b526-955b34f264f3\") " pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:14.126983 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:14.126945    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:14.347683 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:14.347653    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-qztkg_8c3a8259-ada8-4167-a187-c3875098b2e9/download-server/0.log"
Sep 11 21:56:14.425831 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:14.423148    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"]
Sep 11 21:56:15.250017 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:15.249972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf" event={"ID":"400ec2ef-6843-43f8-b526-955b34f264f3","Type":"ContainerStarted","Data":"2a70a0d86f23f7567809017e775c1cda84690e7899ce02a11f49d4983ae1c8c0"}
Sep 11 21:56:15.250429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:15.250054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:15.250429 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:15.250074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf" event={"ID":"400ec2ef-6843-43f8-b526-955b34f264f3","Type":"ContainerStarted","Data":"a603f5477d12a11046ab4de5c05c8fd608df98fd67ba7a6e740df597e4eecf62"}
Sep 11 21:56:16.151730 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:16.151702    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j94n7_866539c7-de3c-4623-a54c-d189a08dfc42/dns/0.log"
Sep 11 21:56:16.173788 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:16.173752    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j94n7_866539c7-de3c-4623-a54c-d189a08dfc42/kube-rbac-proxy/0.log"
Sep 11 21:56:16.243626 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:16.243596    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r5wkq_78f27213-1912-4b33-a88b-dda868cf6097/dns-node-resolver/0.log"
Sep 11 21:56:16.785187 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:16.785161    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97mgb_30685afa-38a1-4e1d-b6e9-74d2328f180e/node-ca/0.log"
Sep 11 21:56:18.653560 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:18.653524    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5564d7bb97-sg8nb_86a54eda-3b78-40eb-8d84-c63e268f9ea2/kube-auth-proxy/0.log"
Sep 11 21:56:18.748237 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:18.748191    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-m785w_59b05160-f986-4e91-a63b-804edaabca66/payload-pre-processing/0.log"
Sep 11 21:56:19.799558 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:19.799520    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z2lpr_fde79141-414e-4126-b217-fcbb5dd41abf/serve-healthcheck-canary/0.log"
Sep 11 21:56:20.410451 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:20.410423    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t29x7_b6d956d1-2630-4f73-ae39-083777ff7b67/kube-rbac-proxy/0.log"
Sep 11 21:56:20.434993 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:20.434950    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t29x7_b6d956d1-2630-4f73-ae39-083777ff7b67/exporter/0.log"
Sep 11 21:56:20.455791 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:20.455760    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t29x7_b6d956d1-2630-4f73-ae39-083777ff7b67/extractor/0.log"
Sep 11 21:56:21.268144 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:21.268118    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf"
Sep 11 21:56:21.287932 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:21.287868    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xhtjn/perf-node-gather-daemonset-fd4vf" podStartSLOduration=8.287846508 podStartE2EDuration="8.287846508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:56:15.266751536 +0000 UTC m=+2337.578976903" watchObservedRunningTime="2026-09-11 21:56:21.287846508 +0000 UTC m=+2343.600071875"
Sep 11 21:56:23.084157 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:23.084118    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b7dbdfb66-8npq5_b8eddc7b-4882-4cec-a611-1c6747d545ca/manager/0.log"
Sep 11 21:56:23.281673 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:23.281646    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-bjkrh_bbc67a51-9d3b-4f29-badd-a9b6f6c259f9/manager/0.log"
Sep 11 21:56:23.303218 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:23.303183    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68b6c4779-bjkrh_bbc67a51-9d3b-4f29-badd-a9b6f6c259f9/copy-manifests/0.log"
Sep 11 21:56:24.685202 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:24.685173    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77b49fdcf4-grjpw_d9c80069-7793-44fb-aad9-0c14806051fe/manager/0.log"
Sep 11 21:56:25.115607 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:25.115577    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5564d7bb97-sg8nb_86a54eda-3b78-40eb-8d84-c63e268f9ea2/kube-auth-proxy/0.log"
Sep 11 21:56:25.166415 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:25.166388    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-m785w_59b05160-f986-4e91-a63b-804edaabca66/payload-pre-processing/0.log"
Sep 11 21:56:27.588522 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:27.588455    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5564d7bb97-sg8nb_86a54eda-3b78-40eb-8d84-c63e268f9ea2/kube-auth-proxy/0.log"
Sep 11 21:56:27.640654 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:27.640617    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-m785w_59b05160-f986-4e91-a63b-804edaabca66/payload-pre-processing/0.log"
Sep 11 21:56:29.883843 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:29.883813    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-n2gzv_e3a09666-6181-4f47-8540-08ec6f876691/migrator/0.log"
Sep 11 21:56:29.908216 ip-10-0-136-69 kubenswrapper[2572]: I0911 21:56:29.908183    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-n2gzv_e3a09666-6181-4f47-8540-08ec6f876691/graceful-termination/0.log"